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HEAD END MULTIPLEXER TO SELECT AND TRANSMIT VIDEO-ON-DEMAND AND 
OTHER REQUESTED PROGRAMS AND SERVICES 

By 

Selim Shlomo Rakib, Fabrice Michel Raymond Quinard, and Peter Albert Monta 

5 

Field of use 

The invention finds utility in the head end offices of cable TV operators, ADSL system 
head end and potentially wireless head ends for delivery of video-on-demand programming 
H in digital format as well as other services such as digital telephony or wideband internet 

access. 

□ Background of the Invention 

;J This is a continuation-in-part of a co-pending U.S. patent application entitled HOME 

p NETWORK FOR ORDERING AND DELIVERY OF VIDEO ON DEMAND, TELEPHONE AND OTHER 

m DIGITAL SERVICES, filed 1/14/2000, serial number 09/483,681 which is hereby 

1y| incorporated by reference. 

Most cable TV systems in the prior art have been broadcast only where individual 
111 programs were modulated onto 6 MHz bandwidth analog RF carriers that were frequency 
if division multiplexed. As the internet became more popular and telephone services became 
deregulated and other digital services became more popular, there has arisen the notion of 
2 0 delivery of digital data over cable TV systems in a portion of the bandwidth unused by the 
analog CATV programs. This gave rise to cable modems. 

Video-on-demand services have been known in hotel television systems for several 
years. Video-on-demand services allow a user to select a program to view and have the 
video and audio data of that program transmitted to her television set. Examples of such 

2 5 systems include: U.S. patent 6,057,832 disclosing a video on demand system with a fast play 

and a regular play mode; 6,055,560 disclosing an interactive video-on-demand system that 
supports functions normally only found on a VCR such as rewind, stop, fast forward etc.; 
6,055,314 which discloses a system for secure purchase and delivery of video content 
programs over distribution networks and DVDs involving downloading of decryption keys 

3 0 from the video source when a program is ordered and paid for; 6,049,823 disclosing an 

interactive video-on-demand to deliver interactive multimedia services to a community of 
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users through a LAN or TV over an interactive TV channel; 6,025,868 disclosing a pay- 
per-play system including a high-capacity storage medium; 6,020,912 disclosing a video- 
on-demand system having a server station and a user station with the server stations being 
able to transmit a requested video program in normal, fast forward, slow, rewind or pause 
5 modes; 5,945,987 teaching an interactive video-on-demand network sytem that allows 

users to group together trailers to review at their own speed and then order the program 
directly from the trailer; 5,935,206 teaching a server that provides access to digital video 
movies for viewing on demand using a bandwidth allocation scheme that compares the 
number of requests for a program to a threshold and then, under some circumstances of high 
l5 demand makes another copy of the video movie on another disk where the original disk does 
?? not have the bandwidth to serve the movie to all requesters; 5,926,205 teaching a video- 
|j on-demand system that provides access to a video program by partitioning the program into 
^ an ordered sequence of N segments and provides subscribers concurrent access to each of the 
f|| N segments; 5,802,283 teaching a public switched telephone network for providing 

1!5 information from multimedia information servers to individual telephone subscribers via a 

Si central office that interfaces to the multimedia server(s) and receives subscriber requests 

: y : and including a gateway for conveying routing data and a switch for routing the multimedia 

0 data from the server to the requesting subscriber over first, second and third signal 

^ channels of an ADSL link to the subscriber. 

2 0 Video-on-demand on cable TV systems to receive requests from cable subsribers for 

video programs or services such as high speed internet access or access to T1 or other high 
speed digital telephony services have not yet completed development. Such systems receive 
upstream requests and deliver requested video programs with associated audio and other 
data, as well as bidirectional delivery of internet protocol packets from LAN or WAN sources 

2 5 coupled to the head end bidirectional delivery of telephony data packets to and from T1 or 

other high speed lines of the public service telephony network. A need has arisen for a 
video-on-demand service over cable TV systems as well as delivery of other services such 
as wideband internet and T1 telephony access over cable TV systems. 
Summary of the Invention 

3 0 A genus of video-on-demand pull technology cable TV systems is defined herein. Each 

system includes one or more "pull multiplexers" and one or more video stream inputs and 
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one or more transmitters or transceivers at the head end, and a plurality of customer 
premises distributed along the downstream transmission medium. 

A "pull multiplexer" is defined as a head end "cherry picker" multiplexer that has 
circuitry and/or software which functions to, at least: 
5 receive upstream program and/or service requests, typically video program 

requests or requests for internet access etc., from the customer premises (or at 
least some of them if an array of pull multiplexers are used to divide up the work); 

map the requests to program identifier codes (hereafter PID) that correspond 
to PIDs that will be in data packets encoding the desired program(s) and any 
1%f associated audio, graphic, text or other auxiliary data and, in some embodiments, 

m communicate PIDs and other packet identifying data to one or more video servers, 

T[ and, in some embodiments, WAN servers and T-carrier interface circuits, to cause 

m them to output data encoding requested programs and "pushed" programs to be sent 

regardless of requests; 

receive one or more streams of compressed data packets (typically MPEG II 
5f but any compression scheme may be used) encoding a plurality of programs and/or 

f|] services (such as telephony or internet access) and cull out those packets that have 

2 program identifier codes, IP addresses or other packet identifier information in the 

Q packet headers that identify the requested program or service data in the payload of 

2 0 the packet as well as data packets associated with the requested program(s) and/or 

services encoding any other audio, graphic, text or other auxiliary data packets that 
are to be used with the the requested program or service; 

assemble the data packets culled out from the input streams into one or more 
output streams with each output stream containing the data packets for multiple 

2 5 requested programs and/or services; 

outputting one output stream to each transmitter, transceiver or modem 
coupled to the downstream medium for transmission on a "logical channel" and 
"subchannel" ("logical channel" means any data path which carries one or more sets 
of data, each logical channel being multiplexed or otherwise physically or logically 

3 0 separated from other data being transmitted to another entity or in another direction 

on another logical channel, each set of data being carried on a subchannel of a logical 
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channel also being multiplexed in any known way from the other sets of data being 
transmitted on the same logical channel) such that each logical channel carries in its 
subchannels one or more components of one or more requested programs and/or 
services and wherein, in the preferred embodiment, the collection of all such logical 
5 channels and subchannels carries only requested program(s) and/or service(s) (in 

alternative embodiments, some of the program slots or subchannels in selected or 
predetermined logical channels will carry data of programs and/or services that 
have not been specifically requested but which are high demand and which almost 
always will have users such as CNN or ESPN) ; and 

1 j|: send downstream messages as to which channel(s) and subchannel(s) the 

jfj program(s) and/or service(s) (in both requested and requested plus broadcast type 

ry embodiments) data will be transmitted on and the PIDs, IP addresses or other 

: -as: 

f* identifier information in the headers of the data packets that are to be used at the 

fy customer premises to filter out the requested programs and/or services and, in some 

embodiments, the broadcast high demand programs and/or services (in embodiments 
u\ where there is not a shared downstream medium such as DSL lines to each customer, 

sis 

!^ the filtering criteria can be dispensed with and the downstream messages only 

q indicate which channels and subchannels contain the requested data). 

^ Any circuitry and/or software that can accomplish these functions in the pull 

2 0 multiplexer are acceptable to practice the invention. Multiple specific examples of such 

systems within the genus of the invention are included within the detailed description 
section below. 

The above definition of the characteristics of the "pull multiplexer" genus assumes 
that the downstream media has sufficient bandwidth that ail the requested (and possibly 

2 5 broadcast) programs and/or services can be transmitted without any downward adjustment 

in the bandwidth of the output streams. This is often not the case however where the 
downstream medium is a hybrid fiber coaxial cable CATV plant (hereafter HFC). In such 
cases, structure to carry out an additional function is necessary in the pull multiplexer. In 
HFC, there is a fixed maximum amount of bandwidth available, and it must be shared by all 

3 0 the users coupled to the cable. Thus, as the number of requested programs and/or services 

rise, more and more bandwidth is consumed. 
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When the load rises to the point that the maximum available bandwidth is about to be 
exceeded, the pull multiplexer must adjust the bandwidth consumption of the output streams 
to stay within the bandwidth constraints. Generally, this can be done by commercially 
available resampling chips. Typically, downward adjustment of bandwidth is done by 
decompressing the compressed data packets and re-compressing them with a different, 
stricter compression algorithm which results in less quality but lower bandwidth 
consumption until the desired bandwidth is reached. 

In an alternative embodiment, a pull multiplexer does all of the above (including 
bandwidth management if necessary) but automatically includes certain high demand 
programs in the output stream(s) even if they have not been specifically requested. High 
demand programs are programs that somebody will want to view almost always. These 
programs are included in one or more output streams at all times in this subgenus of 
species. The remaining program slots in the channels not consumed by broadcast programs 
are devoted solely to programs that have been requested and are shared by all users. 

In another subgenus of species, the pull multiplexer includes a load management 
process that functions to make sure as many users as possible receive their requested 
services and/or programs given the bandwidth constraints of the downstream. In some 
species, this load management process also attempts to group all requested programs and 
services being used at a single customer premises on a single channel if possible so a 
gateway or modem with only one tuner can be used to recover all the data packets of all the 
requested programs and/or services. In some circumstances, a certain high demand 
program has been requested as part of a plurality of different requested programs from the 
same customer premises. Suppose this high demand program is either being broadcast or 
has also been requested my multiple other customers and the channel on which it is being 
transmitted has no available program slots for the other program(s) and/or services that 
have been requested by the customer. In such a case rather than move the high demand 
program/service that is also being viewed/used by other customers to another channel with 
the need for downstream messages to all these other customers telling them where it has 
been moved and an interruption in service, another approach is possible. In such a 
situation, the load management process simply sends another copy of the data packets 
encoding the high demand program/service on another channel which has available slots for 
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the other program(s) and/or services that the customer has also requeste. This way, all the 
requested programs/services can be received with just one tuner in the customer's 
gateway/modem thereby reducing the cost to the customer of their equipment. One or more 
aspects of the processing defined in this paragraph or similar processing described in the 
detailed description section, and the program structure(s) needed to do this processing, are 
referred to in the claims as a means for managing output streams for maximum efficiency. 

As the terms are used herein, a channel is a slice of bandwidth on the downstream 
medium that is typically 6 MHz wide, and a program slot is a slice of the channel bandwidth 
devoted to carrying a requested program. A channel may be a separate radio frequency 
carrier having a center frequency at the middle of the band of frequencies that define the 
channel and passband filtered such that its spectrum does not extend outside the channel 
frequency limits. Typically, each requested program is comprised of a plurality of MPEG 
packets having one or more PIDs. All these packets for each requested program to be carried 
on a channel are included in the output stream fed to the transmitter and then modulated on 
the carrier for that channel. At the customer premises, the carrier is tuned and the digital 
data of the packets is recovered and packets not having PIDs of requested programs are 
filtered out. The remaining packets are sent over a LAN to the settop decoder box that 
requested the program and converted to video signals and other signal formats such as an 
accompanying audio track or on-screen data displayed with the program. 

Alternatively, on fiber optic media, a channel may be a slice of bandwidth centered on 
a particular frequency by a passband filter that filters the spectrum of the output stream 
from the pull multiplexer to reject all frequency components outside the channel's 
frequency limits. For example, the digital data of the various programs carried on the 
channel may be spread spectrum multiplexed and summed and the overall spectrum filtered 
by the passband filter down to a 6 MHz wide spectrum centered on the channel frequency. 

A novel aspect of the video-on-demand systems disclosed herein is that they can not 
only supply video-on-demand programming but also broadband internet access and other 
broadband services through T-carrier interfaces. The process of providing video-on- 
demand services along with push programming as well as broadband services from the head 
end comprises the following steps generally: 
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receiving one or more input streams of MPEG or other compressed video data 
in packets from one or more video servers; 

receiving one or more input streams of internet protocol format packets from 
one or more WAN servers or gateways or routers coupled to a wide area network; 
5 receiving one or more input streams of data packets from a T-carrier 

interface circuit; 

receiving one or more requests for video-on-demand programs and/or 
services encoded in data provided by said one or more WAN servers or gateways or 
routers or said T-carrier interface circuits, said one or more requests transmitted 

1 |f by said customers over an upstream logical channel on said HFC; 

gi mapping said one or more requests to one or more program identifier codes, 

IP packet address information or other packet identifying information, and using said 
m program identifier codes for requested video-on-demand programs to send messages 

J; to one or more video servers telling them which video-on-demand data files to 

1 1 output, and using said program identifier codes and/or IP packet address information 

if or other packet identifying information to cull out compressed video packets of at 

y 2 

fy least requested video-on-demand program(s) and/or service(s); 

if organizing said culled out compressed video packets into one or more output 

fjf data streams, each for transmission by a different cable modem on said shared HFC, 

2 0 each cable modem transmitting one or more logical channels, each with a plurality of 

subchannels; 

sending downstream messages to said customers telling them which logical 
channels and subchannels upon which they can find their requested video-on-demand 
program(s) and/or services; and 

2 5 receiving upstream internet protocol format and/or other format upstream 

data packets and routing them to the appropriate WAN server, gateway or router or 
said T-carrier interface circuitry. 

One of the novel aspects of the systems disclosed herein is that each customer 
premises can have a gateway which allows signals and data from other sources besides a 

3 0 single broadband source such as a DSL line or a cable modem can be supplied to the 

peripherals coupled to the gateway by a LAN. Typical gateways have satellite transceivers, 
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cable modems, DSL modems, an interface to the public service telephone network and tuners 
for conventional TV antennas. All these circuits are interfaced to one or more local area 
networks through an IP packetization and routing process and one or more network interface 
cards. Typical circuitry that couples the signal interfaces to the LAN interface are decoders 
5 to convert digital representations of signals YUV format so that an MPEG encoder can 

compress them down to the available bandwidth on the LAN. Similarly, incoming MPEG 
packets may be decompressed and then recompressed to fit the available bandwidth on the 
LAN. A typical process that occurs in such a gateway contains the following steps: 

receiving one or more requests identifying one or more video-on-demand 

1 tf programs and/or services a user wishes to enjoy; 

|1 transmitting said requests to a head end cherry picker multiplexer which can 

J; supply the requested data; 

If! receiving one or more downstream messages indicating from which logical 

channels and subchannels the data of the requested program(s) and/or services may 
1 6 be recovered from a downstream medium; 

Sf tuning to the specified logical channel and demultiplexing the specified 

fjy subchannels and recovering the requested data as compressed video or other data 

ft] packets; 

Q if the requested program is an analog video broadcast on the airwaves or a 

2 0 cable TV hybrid fiber coaxial cable network, tuning to the requested signal, digitizing 

and demodulating the tuned signal to generate a baseband digital NTSC, PAL or SECAM 
video signal; 

if necessary to meet bandwidth constraints decompressing recovered 
compressed video and other data packets and recompressing them to a lower 

2 5 bandwidth that can be transmitted on the available bandwidth of said local area 

network; 

converting digitized representations of NTSC, PAL or SECAM video signals to 
YUV format if said local area network has inadequate bandwidth to carry 
uncompressed video signals along with other network traffic then existing; 

3 0 compressing YUV format data to MPEG packets having a state of compression 

that fits the available bandwidth; 
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packetizing compressed video and other data into internet protocol packets 
(hereafter IP packets) and encapsulating the IP packets in LAN packets addressed to 
the one or more peripherals that requested one or more program(s) and/or services 
and transmitting said LAN packets over said local area network to the peripherals 
5 that requested the data; 

receiving upstream LAN packets and recovering encapsulated upstream IP 
packets therein; and 

routing said upstream IP packets to either a cable modem, a DSL modem, a 
satellite dish transceiver or a conventional modem for coupling to a public service 
1 § telephone network for transmission on an upstream logical channel. 

S The organization and operation of the customer gateways also provides a unique 

y ability to perform video conferencing without a video phone using only a TV and a video 
p camera coupled to a settop box. The elements of such a video conferencing apparatus are: 
J"; a gateway having interface transceiver circuitry for either or both a digital 

1 5 subscriber line or hybrid fiber coaxial cable of a cable TV system, and having a 



rn 



router and network interface circuit and having means coupling said interface 
f| j transceiver circuitry to said router and network interface circuitry for 

^ compressing at least video and audio video teleconference data received from said 

p digital subscriber line or said hybrid fiber coaxial cable and packetizing said 

2 0 compressed data and sending said packets to said router; 

a local area network coupled to said network interface circuit for carrying 
downstream packets of video teleconferencing data; 

a settop decoder coupled to said local area network for receiving said 
downstream packets of compressed video and audio data and converting them into 

2 5 conventional NTSC, PAL or SECAM format video signals; 

a conventional television coupled to receive and display said conventional 
NTSC, PAL or SECAM video signals; 

a conventional video camera or videophone coupled to said settop decoder for 
outputting upstream conventional NTSC, PAL or SECAM format video signals for the 

3 0 upstream portion of a video teleconference; 
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and wherein said settop decoder includes circuitry to receive said 
conventional format upstream video signal, digitize said video signal, compress the 
resulting data and packetize the resulting compressed into upstream video conference 
packets addressed to said network interface and router of said gateway for 
5 transmission over said local area network; 

and wherein said router routes said upstream video teleconferencing packets 
to the appropriate interface transceiver circuitry for either said digital subscriber 
line or said hybrid fiber coaxial cable, depending upon which medium is being used to 
deliver the upstream teleconference data. 

1 P In general, the functions performed in the pull multiplexers and cable modems and 
i| gateways and DSL modems can be performed by any conventional circuitry that is already 
3 known. Nothing about the structure or operation of the devices described herein is critical 
hR to the invention unless specifically so stated or it is essential to achieve the result described 
J: even if not specifically stated to be critical to the invention. 

15 Brief Description of the Drawings 

3 Figure 1 is a block diagram of one embodiment of a system employing the teachings of 

Fy the invention. 

j| ! Figure 2 is a block diagram of an alternative embodiment of a system within the 

□ genus of the invention having a pull multiplexer at the headend and a gateway at every 

2 0 subscriber which can receive requested video programs and/or services via a downstream 

HFC medium or from DSL or satellite dish inputs coupled directly to the gateway. 

Figure 3 is a block diagram of an alternative embodiment according to the teachings 
of the invention wherein the pull multiplexer at the headend delivers requested video-on- 
demand programs and services via DSL connections to the individual subscribers. 

2 5 Figure 4 is a block diagram of a prior art cherrypicker that has been modified to 

receive upstream program and/or service requests and upstream data and to use the 
program and service requests to cull out data for requested programs and services after 
routing the requests to video and other servers that can supply the requested data and which 
can route upstream data generated by customers to the proper servers. 

3 0 Figures 5A through 5G are a flow diagram of an optional process carried out in the 

gateway to optimize assembly of the output data streams for transmission to customers so 
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that the most requests from the most customers can be honored given the number of tuners 
each customer has. 

Figure 6 is a block diagram of a preferred form of DSL head end cherry picker 
multiplexer. 

Detailed Description of the Preferred and Alternative Embodiments 

Generally, speaking, the genus of the invention includes all species of system 
architectures and methods of operation that have the following characteristics. They will 
include a head end multiplexer that receives upstream program and/or service requests and 
picks out data from input streams that satisfies those program/service requests. These head 
end multiplexers will output data streams for downstream transmission that satisfy those 
requests, and, if necessary adjust the bandwidth of the output data streams to fit the 
available bandwidth. The head end multiplexer will also send downstream messages to the 
modems or gateways at each customer premises indicating on which channels they can find 
their requested programs. 

In some species within this genus, the head end multiplexer culls out data packets of 
popular programs that are frequently watched such as CNN or ESPN and mixes that data in 
with data packets of requested programs on the output stream regardless of whether there 
has been any specific request for the high demand programs/services. 

In other species within the genus, the head end multiplexer also does load 
management to maximize the efficiency with which requested programs are received and the 
available channels and program slots are used. For example, if it is known that three 
requests for three different services or programs have been received from a customer that 
has only one tuner, the management process will instruct the culling or cherrypicker 
switches to pick out the packets for these programs and/or services and put them all on the 
same channel where possible. If necessary, if one of the programs/services is already being 
transmitted on another channel and there is no room left on that channel for the remaining 
programs/services requested by a particular customer, then copies of the packets encoding 
the program/service already being transmitted will be transmitted on another channel that 
has room for the remaining programs/services requested by the customer. 
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In other species within the genus, the head end multiplexer also does bandwidth 
management in environments where available bandwidth is limited and shared between all 
users. Such environments include typical cable TV plants today. The head end multiplexer 
multiplexer, also known as a "cherry picker", manages the bandwidth of the output stream 
such that all requested programs are present in the output stream (assuming sufficient 
bandwidth is available), but their bandwidth is decreased if necessary so as to not exceed the 
available bandwidth on the downstream medium. In such species, the head end multiplexer 
will include circuitry to cull out all the requested program packets from the input streams, 
assemble the culled packets into an output stream and adjust the bandwidth of the output 
stream so as to not exceed the available bandwidth of the downstream medium. This is 
usually done by decompressing the data in the packets culled out from the input stream back 
to its uncompressed form and recompressing it with an algorithm that results in more 
compression so as to reduce the amount of bandwidth consumed by the output stream(s) so as 
to be within the bandwidth constraints of the downstream medium. Usually, the input 
streams are MPEG compressed video streams, but the invention is not limited to video 
program input or MPEG compression. The input stream may be any form of data, even 
uncompressed data, including IP packets or packets re-assembled from T1 timeslots or 
other high bandwidth telephony services. If uncompressed data is received, the cherry 
picker compresses it down to the available bandwidth on the downstream. 

Referring to Figure 1 , there is shown a block diagram of a system according to the 
teachings of the invention. A head end multiplexer or cherry picker 10 receives one or 
more input data streams of any type data. Figure 4 shows a typical head end cherrypicker 
structure. Referring jointly to Figures 1 and 4, there are shown are several video input 
streams 14, 16 from local video and/or multimedia servers, a downlink dish etc. The 
structure and operation of the video and multimedia servers may be any known design 
including the design taught in U.S. 5,802,283 for a multimedia server for an ADSL 
network, which is hereby incorporated by reference. The input streams can also include an 
IP packet stream 15 from a modem, router, gateway or server (not shown) coupled to the 
internet or from a local server coupled to the internet. The input data streams to the cherry 
picker 10 can also include a stream 17 of telephony packets from, for example, circuitry 
coupled to any of the following type of digital data delivery networks over the public 
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switched telephone network: N-carrier, L-carrier, T-carrier, channelized T-carrier (T1, 
E1, J1), DSL, ADSL, HDSL, X.25 packet switched networks, Common Channel Signaling and 
Control (CCS networks), Dataphone Digital Service, Switched 56 Kbps (also known as DSA) 
nets, ISDN, frame relay, or cell switched (SMDS or ATM) network. 

The cherry picker 10 also has an input coupled to any upstream medium 12 for 
receiving upstream program and/or service requests from the users in the customer 
premises. This input is coupled to the receiver section 13 of a modem coupled to the 
downstream in cases where the downstream and upstream are transmitted on the same media 
or to a separate gateway, receiver or modem where the upstream 12 is a separate medium 
such as a telephone line etc. 

The upstream requests identify the requested program and/or services various users 
coupled to the system desired to view and/or use. The gateway 13 controls the upstream 
session via a log-in procedure, authenticates the requestor and her privileges, and validates 
the requested services and/or programs based upon the status as an authorized subscriber 
and whether or not the request is within the privileges of that subscriber. Valid requests 
from authorized users are passed on to a PC motherboard 27 of cherry picker 10. In some 
embodiments, the gateway 13 may also send data downstream to present a menu to users of 
video programs, multimedia files, telephony services or wideband internet access or other 
wideband services which are available for selection by the user. When a valid upstream 
request for a program and/or service is received by the gateway 13, it transmits a message 
to the appropriate server requesting that a video program and/or service(s) identified in 
the message be transmitted to the cherrypicker 10 via the appropriate one of the links 14, 
15, 16 and/or 17. The requests are also passed to the PC motherboard 27 of the 
cherrypicker in Figure 4. 

The cherry picker 10 converts these requests for programs and services to program 
identifier codes (PIDs), IP sources addresses or other identifying codes that can be used to 
cull out the data packets in the input streams that encode the requested programs and/or 
services supplied by the video/multimedia server, the T1 interface circuitry, the internet 
server and/or any dish interface circuitry or other interface to a source of data to which the 
request was passed. 
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The upstream medium 12 can be any medium that can get the program and/or service 
requests to the cherry picker. It can be a telephone link, a satellite uplink, a microwave or 
radio link or it can be an upstream management and control channel that is time division, 
frequency division or code division multiplexed or otherwise kept separate from the 
downstream channels on a downstream medium 26 such as hybrid fiber coax (HFC). The 
cherry picker must have suitable known internal or external circuitry such as a modem, 
receiver etc. that can interface to the upstream medium and recover the program/service 
requests therefrom. In CATV systems, the cherry picker 10 can have built into it or 
separate, a cable modem with a receiver section 13 that recovers the upstream 
program/service requests. Numerous suitable cable modems are commercially available 
including the Terayon TeraPro and DOCSIS modems as well as those of other manufacturers. 
Suitable cable modems are described in U.S. patents 5,768,269 and 5,793,759 which are 
hereby incorporated by reference. 

The cherry picker 10 also includes cherrypicker switch circuitry such as are shown 
at 15, 17 and 19 for generation of three output streams. There are as many switch circuits 
as there are output streams or channels to be transmitted. Each channel carries multiple 
programs/services, typically from four to twelve. The switch circuits 15, 17 and 19 
receive upstream program/service requests on bus 21 from a management process program 
23 in execution on a microprocessor 25 on a motherboard 27. The motherboard has an 
input 29 coupled to the data output of the upstream receiver/modem 13 to receive the 
upstream program/service requests extracted by the receiver 13 from the upstream data on 
medium 12. The cherry picker switches, in the embodiment shown, also include inputs 31 
through 45 for receiving raw data streams from the inputs. These inputs 31 through 45 
are coupled to the raw data inputs 14, 15, 16 and 17 through a plurality of passive 
splitters 47, 49 and 51. These splitters just take each input stream and couple the data 
onto a plurality of output streams that are coupled to the input of the cherrypicker switches. 

Each cherrypicker switch 15, 17 and 19 functions to use the program identifier 
codes, IP source addresses or other identifying information on bus 21 generated from the 
upstream program/service requests to cull out the data packets from the input streams 31 
through 45 that encode the requested programs/services. Typically, this culling process is 
done by switching circuits that receive the PIDs or other identifying information from a 
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management process 23 running on a PC motherboard 27 or other computer coupled to the 
upstream receiver. Each input stream is comprised of MPEG or other packets that have 
headers. MPEG packets that encode video, audio and associated data of programs that can be 
watched on a TV contain program identifier codes. These PIDs map to the more informative 

5 long name such as CNN, Starz, ESPN, etc. Likewise, IP packets, called datagrams, have 

headers which include information that can be used to cull out only the IP packets desired 
from, for example, streaming media IP packet streams. IP datagram headers include fields 
such as: the source IP address, an identification field that allows the destination host to 
determine which datagram an newly arrived fragment belongs to (all fragments of a 
1 0 datagram include the same ID), a fragment offset that tells where in the overall datagram 

m each fragment belongs, and an options field that can be used for source routing information, 

p service identification, security or anything else not thought of in the original standard. 

i5 These header fields are used to determine which IP datagrams or fragments to cull out of the 

a? L : 

if ! input stream. Likewise, telephony packets assembled from fragments delivered in T1 

1 p timeslots etc. can be culled out of the input stream based upon program and/or service 

0 identifying information in the packet header. The PIDs and other identifying information in 
fll each header are examined by the cherrypicker switches and compared to the list of PIDs or 
W other identifying information identifying the requested program(s) and/or services and/or 
the programs/services to be pulled regardless of requests. 

2 0 The culled packets selected by the recoder circuits have the headers stripped and the 

payload data in the packets is then decompressed and recompressed if necessary to reduce the 
bandwidth. This process is done by the recoding circuits 53, 55 and 57. These circuits 
receive the compressed or uncompressed data packets (or a combination of the two) on input 
lines 59, 61, 63 etc. and available bandwidth information from the management process 23 

2 5 on bus 65 from the motherboard 27. Sseparate buses are shown coupling the motherboard 

to multiple circuits, but in reality, all these buses may be simply the motherboard host bus 
and the data described herein just sent to each circuit when that circuit is addressed by the 
address lines on the bus. The available bandwidth information on bus 65 tells the recoding 
circuits how much additional compression to perform or that sufficient bandwidth is 

3 0 available on the downstream to meet the current bandwidth consumption in some 

embodiments. In the preferred embodiment, the available bandwidth information on bus 65 
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just tells the recoder circuits how much bandwidth is available on the downstream. In such 
embodiments, the recoder circuits decide for themselves how much bandwidth is consumed 
by the input streams and how much compression to perform to meet the bandwidth 
restrictions apparent from the information on bus 65. The recoding circuits are known and 
5 commercially available from Terayon Communications Systems, Inc. in Santa Clara, 

California. They were orginally designed by Imedia Corporation and are described in U.S. 
patents 5,956,088 and 5,877,812 and 5,862,140 all of which are hereby incorporated by 
reference. 

The recoder circuits output their compressed data to either the downstream 
1§ transmitters 69, 71, 73 or to the motherboard 27 depending upon whether the recoder 
S circuits include circuitry to repacketize the compressed data. In embodiments where the 
^ recoder circuits include circuitry to repacketize the compressed data into MPEG or IP or 

ifj; other packets for the downstream, the repacketized data for each of three channels is output 
f on buses 75, 77 and 79, respectively to the three transmitters 69, 71 and 73 for these 

1 Ji three channels. 

§f Message data to the transmitters telling each transmitter which data packets to 

ff i transmit on which subchannels can be sent in-band in packets marked with an 
iff administrative code in the headers or out of band on a subchannel or by a physically separate 
p data path (not shown). This is true for all of the embodiments shown in Figures 1, 2 and 3. 

2 0 In some embodiments, the recompressed data is output on a bus 81 to the 

motherboard for repacketization there. These embodiments are symbolized by bus 81 in 
dashed lines. In these embodiments, the repacketized data is transmitted via bus 83 to the 
transmitters 69, 71 and 73 for downstream transmission as appropriate. 

Each downstream transmitter modulates the output data onto a different frequency 

2 5 carrier for coupling to the downstream medium in the preferred embodiment. The 

transmitters multiplex the data of the different channels into different logical channels on 
the downstream by any known form of multiplexing. The downstream multiplexing can be 
FDMA, TDMA, SCDMA, CDMA, STDMA, DMT or, in the case of fiber optic media 
transmissions at baseband, simply a digital burst of packets transmitted in assigned 

3 0 minislots for each transmitter and with programs and services separated at the destination 

host by the PIDs or other identifying information in the packet headers). 
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In alterantive embodiments where bandwidth alteration is not necessary such as 
fiber-to-the curb environments, the switching circuits 15, 17, 19 etc. simply cull out the 
data packets of the requested program and/or services and send them to the downstream 
transmitters for driving onto the fiber without bandwidth alteration. In some embodiments, 
5 the video streams output by the cherrypicker switches are sent to the PC motherboard 27 

for changing of PIDs or addition of other information to packet headers. 

The PC motherboard is programmed to repacketize the culled, recoded data from the 
recoder circuits 53, 55 and 57 into downstream packets and assemble the packets into one 
or more output streams on bus 83 (only in embodiments where recoding and repacketization 
10 is necessary). In all embodiments, the PC motherboard (it could be a Macintosh 
m motherboard or Unix motherboard also) also, optionally, performs a load management 
p process to get all requested programs from any particular customer onto the number of 
!| channels that customer's equipment is capable of tuning. This process is done by outputting 
¥ the PIDs or other information by which to do the culling process on bus 21 such that the 

1 j> cherrypicker switches are controlled to put all the PID data from requested programs from 
O one customer onto the number of channels that customer is capable of simultaneously tuning. 
m If the customer's modem or gateway can only tune one channel at a time, all the PIDs for the 
W requested programs/services are sent to one cherrypicker switch so they will all appear on 
m one downstream channel. The load management process then generates a downstream 

2 0 message addressed to that customer telling the customer upon which channel the requested 

programs/services will appear. If the customer can tune three simultaneous channels, the 
requested programs and/or services can be put on three different channels if necessary, and 
the appropriate downstream messages are generated by the motherboard and sent 
downstream. The downstream messages are sent from the motherboard 27 to the 

2 5 downstream transmitters via bus 83. 

Each output line is coupled to a separate transmitter/modulator in some 
embodiments symbolized by Figure 1 by transmitters/modulators 46, 48 and 50 . Each 
transmitter or modulator modulates the data of its output stream into a downstream channel 
that is typically 6 Mhz wide. Conventional transmitter/modulator circuits suitable for the 

3 0 downstream medium in use can be used. In CATV HFC environments where both the upstream 

and downstream are modulated onto the HFC, all the transmitters/modulators can be a single 
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SCDMA cable modem such as are commercially available from Terayon under the TerraPro 
trademark and described in U.S. patents 5,768,269 and 5,793,759. These modems can 
accepts TDMA input streams having multiple logical channels each one of which is one of the 
output streams from the cherry picker 10 and modulate each output stream onto a separate 
logical channel or program slot of a single 6 Mhz QAM modulated RF carrier. 

Each customer premises has a gateway and/or cable modem coupled to the 
downstream medium such as are illustrated at 28 and 30. The function of these gateways and 
cable modems is to receive the digital data of the requested programs/services and route it 
over a local area network in the customer premises to the settop decoder or other peripheral 
that requested the program/service. An exemplary gateway that can serve the functions of 
gateways 28 and 30 is taught in U.S. patent application entitled HOME NETWORK FOR 
ORDERING AND DELIVERY OF VIDEO ON DEMAND, TELEPHONE AND OTHER DIGITAL SERVICES 
having serial number 09/483,681, filed 1/14/2000, which is hereby incorporated by 
reference. Incoming packets for a video program that have been requested via settop decoder 
18 are encapsulated into an Ethernet or other LAN packet (depending upon the LAN 9 in use 
and sometimes hereafter referred to as simply Ethernet packets for brevity) and routed to 
the appropriate settop decoder that requested the program such as settop decoder18 
(sometimes the IP packet header information is stripped and in other embodiments it is not 
but the PIDs or other program information is not stripped). If multiple requests have been 
made from different settop decoders in the same household, the LAN packets for the different 
programs requested are addressed to the settop decoders that requested each particular 
program. 

At the settop decoder, the payload data on all the program slots dedicated to this video 
program such as the audio and video data is decompressed back to its original resolution and 
converted to a signal format on line 116 suitable for television 100. If TV 100 is an NTSC, 
PAL or SECAM TV, the appropriate analog signal format such as an NTSC signal modulated 
onto RF channel 3 or 4 is generated. If the settop decoder is coupled to the video or S-video 
and audio inputs of the TV that bypass the tuner, the video and audio data is converted into 
analog composite video and audio signals on line 116. In some embodiments, each TV will 
have an intelligent remote control such as is shown at 102 and 104. Each of these remotes 
has a bidirectional radio frequency or infrared link to the settop decoder, and each of these 
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remotes has a miniature display thereon upon which digital data associated with a program 

may be displayed either with or without simultaneous display on the data shown on the TV. 

For example, if a user is watching Goldeneye on TV 100 suppose there is associated digital 

data with this video program for home shopping when 007's car is in the scene such "BMW 
5 Z3 Roadster available locally from Acme BMW, phone number (408) 555-1212". This 

message can be displayed on the minidisplay on the remote only or both on the minidisplay 

on the remote and on the TV also. 

The customer premises gateway or cable or ADSL modem in each customer premises 

is also coupled to other peripherals in the household such as computers or telephones or 
1^1 FAXes or digital VCRs or network computing devices (no local hard drive) via one or more 
S local area networks. For example LAN 9 in customer #1's house couples gateway 28 to a 
|W digital phone 108 and a PC or Mac personal computer 110. A second LAN 11 couples 
m gateway 28 to FAX 452 and another personal computer 454. The second LAN 1 1 may have a 

different medium type, use a different protocol or be of higher bandwidth than the first LAN 
1,5 as long as the gateway 28 has the appropriate network interface circuitry to interface to 
!*? said second LAN. 

Sj! Each gateway at a customer premises also may have inputs for and appropriate 

^ interface circuitry to receive broadcast data and other digital services such as DirectPC data 

m from a satellite dish 456, a terrestial broadcast TV antenna 458, the public service 

2 0 telephone service network 460 or a DSL line 462. The gateway 28 includes circuitry to 

interface to each one of these signal sources, recover digital data from the source or digitize 
incoming analog signals, compress the data if necessary because of bandwidth availability 
conditions on the local area networks, encapsulate the data into IP packets and then into LAN 
packets and route the packets to the peripheral that requested the program/service. 

2 5 Upstream data from the peripherals will be received by the gateway from the LANs, the 

Ethernet packet headers will be stripped off and the IP packets routed to the appropriate 
interface circuitry interfacing the gateway to the appropriate upstream data path (which 
will depend upon the downstream medium upon which the downstream data arrived). For 
example, if DirectPC IP packets are received from the satellite dish, any upstream IP data 

3 0 packets will be routed to a conventional modem circuit in gateway 28 coupled to PSTN 460. 

Likewise, if downstream IP packets were received from the DSL line, upstream packets will 
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be routed to a DSL modem in gateway 28 coupled to the DSL line for upstream transmission 
on the upstream DSL channel. If downstream IP packets are received from downstream 
medium 26 and it is hybrid fiber coax (HFC), upstream packets will be routed to a cable 
modem in gateway 28 which has an output coupled to the HFC for transmission on the 
5 upstream logical channel. 

Typically, wideband internet access IP packets will be encapsulated into Ethernet 
packets by gateway or cable/DSL modem 28 and addressed to the PC 1 10 or PC 452. The 
network interface card (not shown) of PC 110 or PC 452 receives the Ethernet packets and 
strips off the Ethernet headers and passes the IP packets up through the IP protocol stack to 
1® the application that requested them. If the application has IP packets to send back out to the 
m internet through the headend, the packets are generated in the application and sent down to 
y the network interface card. The NIC encapsulates them into Ethernet packets and transmits 
m them to gateway or cable/DSL modem 28. The gateway/modem 28 then takes these packets 

J and transmits them to the headend via data path 118 and whatever upstream data path 12 is 

1 s 5 being used using whatever form of multiplexing and modulation is being used. For example, 
If;; if gateway/modem 28 is a cable modem and the upstream data path 12 is hybrid fiber coax, 
flj then the IP packets are disassembled and interleaved, Trellis encoded, code division 

multiplexed onto whatever logical channels are assigned to cable modem 28 and QAM 
□ modulated onto the RF carrier being used to frequency division multiplex the upstream data 

2 0 from the downstream data. At the headend cherrypicker, a cable modem receives the 

upstream signals from cable modem 28 and recovers the IP packets in conventional manner 
and routs the IP packets out to the internet over data path 15 to a server or router at the 
headend coupled to the internet. The server is a file management system which functions to 
receive input video and/or multimedia or other files from providers, store these files with 

2 5 descriptor information about them, keep track of sessions, serve the data files out on links 

to the cherrypicker, and handle requests for files from the cherrypicker motherboard. 

Telephony works the same way. Incoming data from one or more logical channels on a 
T1 line for example enter the headend via link 17. Link 17 is typically coupled to known T1 
interface circuitry that is responsible for gathering bytes from T1 timeslots assigned to a 

3 0 particular conversation and packetizing them into IP packets addressed to, for example, 

telephone 108. These IP packets are culled out of the stream of packets on line 17 by 
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cherrypicker 10 and output in the output stream devoted to the channel and program slot to 
which telephone 108 has been assigned for a particular session. The IP packets are then 
transmitted downstream to gateway 28 by whatever transmitter and downstream media 26 
is in use. At gateway 28, the IP packets addressed to telephone 108 are recovered and 
5 encapsulated into Ethernet or other LAN packets addressed to telephone 108. At the 

telephone, the Ethernet packets are received and the encapsulated IP packets are recovered 
and the payload data is converted to analog signals for use by the telephone. Analog signals 
generated by telephone for transmission out on the T1 line are then digitized and 
encapsulated into IP packets addressed to the T1 line interface circuitry (not shown) 
10 coupled to the cherrypicker 10. Obviously, the telephone 108 may a video conferencing or 
S other high bandwidth device needing T1 bandwidth. The outgoing digital data from the 
D telephone 108 or video phone or video teleconferencing apparatus also represented by 108 
!J- is then encapsulated into IP packets addressed to the T1 line interface circuitry coupled to 

the cherrypicker 10 at the headend. These IP packets are then encapsulated into Ethernet or 

1 B other LAN packets addressed to the gateway/modem 28 and transmitted over the LAN to 

D gateway/modem 28 where they are received and the IP packets recovered. The IP packets 
are then transmitted upstream to the cherrypicker 10 via data path 118 using whatever 
LM form of multiplexing and modulation that is conventional for the upstream path 12. If the 
S upstream data path 12 is shared by all the customer premises for both upstream and 

2 0 downstream data transmission, then some form of upstream multiplexing such as SCDMA, 

CDMA, FDMA or TDMA is used to separate the upstream data from the various customers. In 
addition, the upstream data must be multplexed to keep it separate from the downstream 
data. Typically FDMA is used for that purpose but other forms of multiplexing could also be 
used. If the downstream and upstream data paths 26 and 12, respectively, are DSL lines, 

2 5 there is no need for multiplexing to separate the data from different customers since each 

customer gets her own DSL line, and conventional DSL multiplexing to separate upstream 
from downstream data is used. 

At the headend, the upstream IP packets for telephony and wideband internet access 
are recovered by conventional upstream receiver/modem/gateway 13. The IP packets are 

3 0 then transferred to the PC motherboard 27 where a routing process examines the IP 

destination addresses and routs each packet onto the appropriate one of the lines represented 
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by bus 120. This bus contains individual lines coupled to the T1 interface circuitry via data 
path 17 and to the server, router or gateway circuitry (not shown) coupled to the internet 
and coupled to the cherrypicker 10 via data path 15 in some embodiments, and, in other 
embodiments, is a packet data network sharing a single transmission medium to which both 

5 the T1 interface circuitry (not shown) and the internet server, gateway or router (not 

shown) are connected by network interface cards. IP packets to be sent out over the internet 
are routed by PC motherboard 27 onto line 122 and IP packets to be transmitted on the T1 
line are routed onto line 124. These lines 122, 124 symbolize either separate physical 
data paths to the wide area network server(s) and telephone company digital switches or 
1® separate upstream logical channels transmitted to these servers on the same medium upon 

m which downstream IP packets and telephony packets were transmitted to the cherry picker 

S 10. 

m At customer premises #2, LAN 106 connects a gateway 30 to two different settop 

decoders 22 and 24 each of which converts the video and audio packets of requested programs 
%5 into video and audio analog signals on lines 112 and 114, respectively. 

O Either the remotes 102 or 104 or the settop decoders 18, 20, 22 or 24 can be used 

pjj to enter video-on-demand program requests. If the remotes are used to enter program 
^ requests, the identifying information is transmitted by an RF or infrared link to the settop 

S decoder associated with the remote. These RF and IR links are symbolized by dashed lines 
2 0 126 and 128 in Figure 1. Service requests are generated by one or more telephones and/or 

personal computers and/or other peripherals at each customer premises. Each service 
request is encapsulated into an Ethernet (or other LAN) packet which may be addressed to 
the gateway/modem 28, 30 etc. or, in alternative embodiments, to the settop decoder 
circuits 18, 20, 22 or 24. These program and service requests are transmitted from the 

2 5 gateway/modem or settop decoder to the headend cherry picker via data paths 118 or 130 or 

132 or 134 or 136 or 138, as appropriate. At the headend cherrypicker upstream 
rece j ver / mo dem13 in Figure 4 recovers the program and service requests and passes them 
on to the PC motherboard 27. There they are processed and the PIDs and source addresses in 
IP packets to be culled out and put into the various output streams on lines 75, 77 and 79 

3 0 are derived and relayed to the culling switches 15, 17, 19 etc. The video program and 

service requests can be sent as long program names and then converted at the headend PC 
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motherboard into PIDs and/or IP source addresses or other identifying information by a 
table lookup process. The PIDs and/or IP source addresses or other identifying information 
to be used by the culling switches to pull out the desired programs and services are sent to 
those switches via bus 21. 
5 A system architecture according to the genus of the invention will have the following 

characteristics which are illustrated in Figure 1. 

First, a head end multiplexer 10 receives upstream requests for desired 
programs via any path 12. The upstream path can be a satellite uplink, a wide area 
network, the internet, an FDMA, CDMA or TDMA upstream channel on the same 
1 @ medium used to transmit the downstream data or the public telephone network, 

it* Second, the cherry picker 10 must receive one or more input data streams 

O 14 and 16 of raw data of various programs from which the requested programs are 

lp culled. The input data streams are typically video streams of MPEG compressed 

¥ video, audio and other associated data defining a plurality of programs. The 

1 jj architecture of the invention is not limited to video program data, nor is it limited to 

B MPEG compressed data. In some embodiments, the input data streams on lines 14, 

on 

fy 16 etc. can be IP packets, telephony packets, video packets with associated audio and 

W data compressed with MPEG or any other compression scheme, MP3 data, or any 

PHI other types of data packets or streams known now or invented in the future or some 

2 0 combination of the above. All that is necessary is that the incoming data packets or 

stream have PIDs or IP addresses or some field of information that identifies the 
service or program the data encodes so that the cherry picker 10 can cull out 
requested services or programs or services or programs with high demand that are 
supplied on a constant or regularly scheduled basis on one or more channels on the 

2 5 downstream medium 26. This raw input data is supplied from one or more local or 

remote video servers, satellite downlinks, internet service providers, T1 or other 
high bandwidth lines, or other sources on one or more inputs to the cherry picker 
10. 

Third, there must be circuitry somewhere to map whatever code, channel 

3 0 number or name that is used by the user to designate the desired program or service 

to one or more program identifier code(s), hereafter PID(s), IP source addresses or 
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any other identifier of the program or service the data encodes. In the case of PIDs, 
the PIDs mapped to the requested program(s) will be in the MPEG packets of the 
video, audio and any associated data packets of the desired program(s) in the input 
video streams on lines 14, 16 etc. In the case of other types of services such as high 
5 speed internet access, telephony over CATV cable plants, or fiber-to-the-curb 

plants, etc. This mapping function can be done at the cherry picker 10 or, 
alternatively, it can be done at the settop decoder boxes such as are shown at 18, 20, 
22 and 24 such that the upstream program requests are already in the form of the 
PID(s) that identify all the components of the desired program. These PIDs will be 
in the MPEG packets of the video, audio and any associated data packets of the desired 
cp program(s) in the input video streams on lines 14, 16 etc. These PIDs are what the 

y cherry picker 10 uses to cull out all the MPEG data packets of the requested 

yfi programs from the input streams 14, 16 etc. In embodiments where the video, 

^ telephony, wideband internet access and other servers do not provide all video 

1gg programs and services available to the input of the culling switches at all times, 

there must also be circuitry such as a gateway to route valid requests for video 
fy programs and/or services to the appropriate servers to cause them to transmit the 

ji" data of the video program or service to the culling switches. 

Sab? 

□ Fourth, there must be circuitry in the cherry picker(s) 10 that uses the 

2 0 PID(s), IP addresses or other service and/or program identifiers identified by the 

mapping process to cull out the data from the input streams that encode the 
program(s) and/or service(s) requested by the user(s). The culled out data packets 
from the raw data input streams are then assembled into output data streams, each 
stream to be transmitted on one channel and each stream encoding one or more 

2 5 programs or services up the maximum capacity of the channel. 

Fifth, there must be some downstream medium and an upstream medium, but 
these mediums can be shared with the upstream and downstream traffic multiplexed 
to keep it separate. The medium type is unimportant and can include hybrid fiber 
coaxial cable plants of CATV systems, the airwaves, DSL lines, microwave links, 

3 o wireless or other cellular systems and satellite downlinks and satellite uplinks or 

telephone lines for the upstream. 
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Sixth, bandwidth adjustment must be performed if the amount of data 
requested and "pushed" can exceed the available for the requested and "pushed" data 
on the downstream medium in use. Data that is "pushed" is data of programs and 
services not specifically requested which ordinarily has a high demand level and is 

5 broadcast without request because of the high probability that someone will have a 

request for it active). The use of pushed data for high popularity programs and 
services helps save bandwidth because multiple customers may be watching the same 
program and only the number of subchannels needed to carry the components of the 
pushed program or service are consumed regardless of how many customers are 
W tuned in. Thus, for example, "Who Wants To Be A Millionaire" can be pushed on two 

Si subchannels for its audio and video components even though 1000 customers are 

0 simultaneously watching it. 

SB 

jjE Referring to Figure 2, there is shown a block diagram for a species of system employing the 

teachings of the invention and which uses Hybrid Fiber Coaxial cable 200 of a CATV system 
VS for both the upstream and downstream mediums. In this sytem, the headend pull 
B multiplexer 202 is structured and operates in approximately the same way as the pull 
fl'ij multiplexer 10 in Figure 1 except that the upstream program and service requests and 
W upstream data packets are recovered by the cable modems in cable modem bank 204 and are 

j?2 transmitted to the pull multiplexer via line 206 as upstream messages and/or IP packets 

2 0 and are simply routed to the correct place. If the upstream data is requests for programs 

and/or services, the computer (not shown) in pull multiplexer 202 maps the names of the 
programs and/or services to PIDs, IP source addresses or other data for use in culling out 
the requested data from the incoming streams of data on lines 14, 15, 16 and 17. In cases 
where the video-on-demand and other servers do not output the data of all possible services 

2 5 and programs that can be requested simultaneously, the pull multiplexer 202 also functions 

to route the PIDs and other identifying information specific to the programs and services 
requested to the video-on-demand server and other servers as appropriate to cause them to 
output the requested data. 

The culled data is packetized into MPEG or other compression format packets after 

3 0 having been bandwidth adjusted if necessary and grouped into one or more output streams 

208, 210 and 212, each output stream having packets for multiple programs and/or 
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services therein. Each output stream is supplied as a data input to one cable modem in a 
bank of cable modems 204. Each cable modem multiplexes the data from the different 
programs and services in the input stream into different logical channels by any known 
form of multiplexing such as frequency division, code division or synchronous code division, 
5 time division or synchronous time division, discrete multitone etc. The different logical 
channels are each then modulated onto one or more carriers that are frequency division 
multiplexed from each other and from the upstream data by any known form of modulation 
such as by quadrature amplitude modulation, QPSK etc. 

Downstream message from the pull multiplexer to the subscribers indicating which 
1® carrier and logical channel on that carrier carry the requested programs and/or services 
m are also transmitted downstream either as broadcasts or as point-to-point transmissions 
3 individually addressed to the subscribers that made the requests. The downstream messages 
m are typically transmitted on one or more logical channels dedicated to management and 
jf control traffic or they may be transmitted on a subchannel or by any other out-of-band or 

15 in-band scheme known in networks for transmitting management and control data. If the 

Ef downstream messages are broadcast, the individual gateways at each customer premises 
%l compares the PIDs and/or other identifying information in the broadcasts with the PIDs 

W and/or other identifying information of the programs and services that were requested to 
g find the carrier and logical channel on which the requested data will be arriving. 

2 0 The structure and operation of the gateways and cable modems at the customer 

premises such as gateway 214 and cable modem 216 are similar to the gateways and cable 
modems previously described in Figure 1. Incoming MPEG and IP packets for requested 
programs and services is recovered from the carriers and logical channels indicated in the 
downstream messages. The Ethernet addresses of the peripherals that requested each 

2 5 program and service is then looked up based upon the PID and/or IP source address or other 

identifying information in each incoming MPEG and/or IP or other format packet. When the 
peripherals generate their program and/or service requests, they are encapsulated into 
Ethernet packets and transmitted to the gateway or cable modem. Each request is recorded in 
a table that contains entries to identify the program/service requested and the Ethernet 

3 0 address of the requesting peripheral. Incoming packets from the headend usually only have 

PIDs and/or IP source and destination addresses but they may also have other identifying 
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information. In some embodiments, the gateway 214 and cable modem 216 maintain a 
mapping table at least between the PIDs and IP addresses or other identifying information of 
all programs and/or services requested and the information such as the long name or menu 
number identifying that program or service received from the peripheral. This table can be 
stored in nonvolatile memory such as ROM if the mappings do not change or may be built in 
RAM at powerup time by a request to the headend to download the current mapping table. 
Basically, any known way of figuring out to which peripheral the data packets for each 
requested program and/or service are supposed to be addressed will suffice for purposes of 
practicing the invention will suffice. 

After determining which peripheral requested the recovered MPEG and IP packets 
and other packets encoding the requested program(s) and/or service(s), the recovered 
packets are encapsulated into Ethernet or other LAN packets. These LAN packets are 
addressed to the peripheral that requested them and driven onto the LANs 218 and 220. Note 
that in the embodiments of Figures 1 , 2 and 3, the gateways may be coupled to the 
peripherals by individual dedicated coaxial cables, twisted pairs, Cat 5 wires, phone lines 
or power lines or a wireless connection using various technologies currently available. For 
example, instead of a shared media network like 218, or in addition to this network, 
individual connections or alternative networks such as power line or telephone line or 
wireless networks symbolized by lines 694, 696, 698 and 700 may be used. Specifically, 
lines 694, 696, 698 and 700 may represent Home PNA telephone line networks which may 
have only one (or more) peripherals attached thereto, or Category 5 LAN droplines with 
only one (or more) peripherals attached thereto, or power line networks each having one or 
more peripherals attached thereto offered by Inari or Itran or Intellon to save the expense 
of rewiring the home to add a network. In addition, the connection from the gateway to each 
peripheral may be by a wireless network such as those offered by Blue Tooth or specified in 
the 802.11 standard. In addition, the drop lines 694 etc. may each be a separate, dedicated 
coaxial line or twisted pair. The gateways 20 and 30 in Figure 1 and 214 in Figure 2 and 
308 in Figure 3 will each have a plurality of individual line driver modules which can be 
coupled to the gateway backplane. Each module is designed to drive a different type of 
network connection or dedicated line. All these line driver modules receive IP packets from 
the routing process in accordance with whatever peripherals are coupled to each line and 
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drive them onto the particular type of media the driver is designed to drive using whatever 
protocol the particular line requires. Line driver circuits for each of the dedicated and 
shared media types identified above are known. Driver modules for indivual coaxial cables 
that were previously installed in a home to distribute CATV signals simply include 
multiplexers to transmit FDMA separated upstream and downstream logical channels in the 
bandwidth not used by the analog CATV signal. 

The peripherals may include, but are not limited to settop decoders 220 and 222, 
digital phones 224 and 226, digital VCR 228, and personal computer 230. Upstream 
requests for programs and services and upstream data such as IP packets from these 
peripherals are encapsulated into Ethernet packets and sent to gateway 214 and cable modem 
216. There, the Ethernet headers are stripped and the requests and upstream data are 
transmitted on HFC 200 on the upstream logical channel(s) that are devoted to upstream 
traffic. The cable modems in cable modem bank 204 recover the upstream requests and data 
and transmit it over data path 206 to a computer 232 in the pull multiplexer. The requests 
are routed to the culling switches in all embodiments and to the servers that supply the raw 
input data in some embodiments. The upstream data is routed to the appropriate telephony 
interface circuitry or internet server/gateway/router for transmission to the host or 
device on the other side of the transaction. 

***Referring to Figure 3, there is shown a DSL embodiment of a system that 
employs a DSL headend multiplexer within the genus of the invention. Figure 6 is a block 
diagram showing more detail of a DSL multiplexer that can be used as the headend 
cherrypicker in the DSL environment. The reader should refer jointly to Figures 3 and 6 
for the following discussion. Operation of this embodiment is similar to that of Figure 2 
except that the downstream and upstream medium to each customer premises is a DSL 
telephone line so there is no sharing of the upstream and downstream medium by data bound 
for different customers. 

Each customer has a DSL modem such as 242 and 244 which couples the DSL line to 
an Ethernet or other local area network such as 246 and 248 coupled to all the peripherals 
at the customer premises. The peripherals can include but are not limited to settop decoders 
250, 252 and 254, phones 256 and 258, digital VCR 260, FAX 261, personal computer 
262 or network computing appliances and can include household appliances that are internet 
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ready for remote service calls and diagnosis or remote control. Some of the peripherals 
generates upstream requests for programs and/or services, and can generate them in any 
way. Typically, upstream requests for programs and services are generated by selection 
from a menu displayed on the peripheral such as a television coupled to a settop decoder. The 
5 menus are generated on the TV screen, computer screen, phone or FAX display from 

downstream menu data transmitted on a management and control channel of the DSL line to 
each customer premises, said downstream menu data encoding all available programs and/or 
services. 

Each peripheral may also generate upstream data for transmission out on a wide area 
10 network 600 or a T1 line 602 or other wideband data delivery network. In addition, 

conventional analog telephones (not shown) can be connected to POTS outputs of the DSL 
U modems at each customer premises, and they can generate upstream analog POTS signals 
j5 which are transmitted over the POTS baseband channel of the DSL line to the DSL modem at 
fr- the headend. At the headend DSL modem, the POTS analog signals are recovered and output at 

1 f POTS outputs. Each POTS output of a DSL modem is coupled by a bidirectional tip and ring 
Q pair such as 604 for customer #1 and 606 for customer #2 to a CO POTS switch 608. 

m In addition, video phone 258 and digital FAX 261 coupled to the LAN at each customer 

yy premises can generate digital telephony data such as video conference pictures and audio that 
g needs to be transmitted upstream for routing to the WAN server or T1 interface circuitry at 

2 0 the headend or via a satellite uplink via dish 340 and dish transceiver 342 for delivery to 

the destination. In addition, other peripherals coupled to a customer LAN such as personal 
computers 262 and may also generate upstream data that needs to be delivered to its 
destination by WAN 600 or T1 line 602 or a dish uplink or via PSTN interface circuitry 
319 and a conventional telephone line such by a DirectPC PSTN upstream link. 

2 5 The requests and upstream telephony and other data are transmitted to the customer 

gateways or DSL modems as Ethernet or other LAN packets. For example, at customer #2 
gateway 308, the gateway or its internal DSL modem 244 strips off the Ethernet headers 
and CRC bits after error correction and transmits the requests and data to the appropriate 
place. All requests for programs/services are transmitted upstream either via the DSL line 

3 0 310 to the DSL central office or on the upstream logical channel of the HFC 316. All 

upstream data that needs to be delivered to its destination via WAN 600 or T1 line 602 is 
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transmitted upstream via DSL modem 244 or upstream to the CATV headend via cable modem 
318. All upstream data that will be delivered to its destination by a satellite uplink or a 
PSTN connection is delivered to the proper interface circuit in gateway 308 such as dish 
transceiver 342 or PSTN interface 319. 
5 Typically, requests for programs/services are transmitted on a management and 

control channel on an upstream logical channel transmitted on a carrier of a bidirectional 
channel that is frequency division multiplexed from the DSL baseband POTS telephony 
channel and the DSL wideband downstream only logical channel. Bidirectional IP packet and 
telephony data such as video conference data and internet access data is transmitted both 
1QB upstream and downstream on upstream and downstream logical channels of the bidirectional 
S channel, or, in alternative embodiments, may be transmitted on upstream and downstream 

0 logical channels of the 1.544 Mbps wideband DSL channel. Other downstream only wideband 

;S| data such as video-on-demand and other services are transmitted in the 1.544 Mbps 

wideband downstream only DSL channel, or, in alternative embodiments, in a separate 
15 downstream logical channels on 1 .544 Mbps wideband data channel that is FDMA multiplexed 

S3 from the other channels. The DSL modems at the customer premises and the head end each 

fjij transmit and receive telephony, IP packet, management and control data, video-on-demand 
W data and other service data on separate logical channels on the appropriate carriers and 

S channels as described above. 

2 0 A DSL modem such as 270 and 272 at the headend is devoted to each DSL line to a 

particular customer. Each DSL modem at the headend has a conventional structure. DSL 
modems are commercially available from 3COM. Each DSL modem at the headend and the 
customer premises functions to send and receive information on three channels: a separate 
analog channel for "plain old telephone service" (referred to herein as POTS); a high speed 

2 5 wideband downstream channel based upon T1 specifications in increments of 1.536 Mbps up 

to 6.144 Mbps (referred to herein as the wideband channel); and, a bidirectional channel 
provided in increments of 64 Kbps up to 640 Kbps (referred to herein as the bidirectional 
channel and which carries requestes and upstream data in the preferred embodiment). DSL 
service is described in Horak & Miller, Communications Systems and Networks, Voice, Data 

3 0 and Broadband Technologies (1997) M&T Books, Foster City, California, ISBN 1-55851- 

485-6 which is hereby incorporated by reference. 
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At the headend, telephony data packets arrive on line 17 from the T1 interface 
circuitry 610 (T1 interface chipsets are commercially available). Further, analog 
telephony signals generated from "plain old telephone service" (hereafter POTS) arrive 
from a central office POTS switch 608 on line 304 in Figure 3 which corresponds to each 
5 customer's tip and ring pair in Figure 6, of which pairs 604 and 606 in Figure 6 are 

typical. The POTS lines for each customer are connected to POTS inputs of the corresponding 
DSL modem. 

Digital telephony packets reach the DSL modems a different way. The pull 
multiplexer 240 in the central office 239 culls out digital telephony packets addressed to 
13) each separate telephone number using culling information on lines 614 and 616. This 

culling information is generated by control computer 618 from upstream program/service 
D requests received on lines 620 and 622 from the DSL modems 270 and 272. The requests 

it* on line 620 are customer #1's requests, and line 622 carries customer #2's requests. The 

jf- DSL modems recover these requests from the bidirectional upstream channels of DSL lines 

15 312 and 310 of customers #1 and #2, respectively. The headend cherrypicker 240 routes 

the telephony data packets to the appropriate DSL modems 272, 270, etc. This routing may 
ss be by way of a separate data path to the DSL modem (not shown) or over buses 305. In the 

Ly preferred embodiment, the telephony packets are simply put on a separate logical channel 

f£ (separated from the video and other service packets by header information) in the input data 

2 0 stream to the DSL modems. The slash marks in these lines symbolize embodiments that 

have three separate inputs to each headend DSL modem: one for POTS telephony, one for 
downstream management and control data and downstream IP data and other data not 
requiring high bandwidth; and one for high bandwidth downstream data such as requested 
video-on-demand programs and services or pushed programs and/or services. In 

2 5 embodiments where the headend DSL modems have a single digital data input, the telephony 

packets, IP packets and video-on-demand packets and other service packets in the input 
stream from the cherrypicker 240 are culled out in the modem by information in the 
headers in accordance with management and control messages received from the 
cherrypicker. These management and control messages tell the DSL modem which channel 

3 0 and logical subchannel to use to transmit each packet. These management and control 

messages are sent to the DSL modems from the control computer 618 via the data paths 626 
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and 628 in Figure 6. The DSL modems use those control messages for two functions. First, 
these messages are used to control the DSL modem modulators to get the requested and pushed 
programs on the logical channels and subchannels specified in the message. Second, these 
messages are sent to each customer on the bidirectional channel to tell the customer gateway 
5 or DSL modem on which channels and subchannels it can find the requested and pushed data so 

the gateway or DSL modem can properly tune its tuners to recover the requested and pushed 
data. 

Upstream telephony, request data and other upstream data from the telephones and 
other peripherals at the customer premises are encapsulated into Ethernet packets and 
135 addressed to a DSL modem or gateway. In the case of customer #1 , the upstream data on the 
5t LAN is addressed to DSL modem 242, and in the case of customer #2, the upstream data is 

D addressed to the gateway 308. The gateway 308 routes the telephony packets and upstream 

request data and other data to be transmitted to the headend to an internal DSL modem 244. 
M 8 The DSL modem 244 transmits the upstream data and telephony packets on the bidirectional 
f B channel (or an upstream logical channel in the broadband channel in some embodiments). 
G; Analog POTS signals from any conventional telephones 630 and 632 coupled to the DSL 
t\ modems 244 and 242 are transmitted upstream as analog voice and POTS call control and 

L4; call progress signals on the baseband POTS channel. 

™ At the headend DSL modem for each customer, the analog voice and call control POTS 

2 0 signals are recovered and transmitted on the appropriate tip and ring pair, e.g., 606 and 

604 for customers #1 and #2, to the CO POTS switch 608. Upstream request data and other 
upstream data such as IP packets are recovered by the DSL modem of each customer from the 
bidirectional channel or logical upstream channel of the broadband channel and sent to the 
control computer 618 via data paths 620 and 622 for customers #1 and 2, respectively. 

2 5 The control computer 618 then routes these upstream data packets either to the T1 

telephony interface circuitry 638 via line data path 636 or WAN gateway/router/server 
640 via data path 642. 

The DSL modems 272, 270, 242 and 244 send and receive upstream and downstream 
management and control packets on the bidirectional channels of DSL lines 310 and 312. 

3 0 The management and control channels are transmitted on a carrier centered on 95 MHz 

which provides 8 Kbps of bandwidth for management and control messages and handshaking 
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protocol between the subscriber and CO. This carrier of the bidirectional channel is used to 
test the copper pair transmission path and to provide approximately 16 Kbps of upstream 
D-channel bandwidth from the subscriber premises to the CO for request messages and 
upstream data such as IP packets, video conferencing data, etc. In alternative embodiments, 
5 the 1.544 Mbps broadband channel is bidirectional and the upstream and downstream data 

are multiplexed into separate logical channels by TDMA, FDMA, CDMA or DMT. In other 
alternative embodiments, the D-channel is bidirectional and reserved for upstream data that 
can be sent within its bandwidth and higher bandwidth upstream traffic like video 
conference data of higher quality is multiplexed onto an upstream logical channel of the 
1jg broadband channel with the downstream logical channel carrying compressed video and and 

downstream IP packets of requested and pushed video programs and services. 
q The high bandwidth data of downstream requested programs and services and pushed 

;|f programs and services is modulated onto the broadband 1.544 Mbps channel extending from 
j±& 100 to 500 Khz. The high bandwidth channel typically carries downstream only (CO to 

1 ! S subscriber) digital data and provides 1.544 Mbps transport (1.6 mbps with overhead) for 

pi carrying digitized compressed video data and IP packets. The lower edge of the high 
'fl bandwidth channel is set at 120 Khz, which is chosen to minimize channel loss and allow 

ff it 

y appropriate bandwidth for the baseband telephony channel and the bidirectional channel. 
|jf This minimizes interference from impulse noise. The combined digital downstream signal 
20 utilizes the DS1 bit map specified by ANSIT1 .403-1 989. 

Although the broadband channel generally is downstream only, in some embodiments, 
high bandwidth upstream traffic can also be multiplexed thereon. There is no need for 
multiplexing if data transmission is unidirectional downstream on the high bandwidth 
channel since only the programs and services requested by one user are on that user's DSL 

2 5 line. If, however, upstream video conference telephony and IP packet data is to be 

transmitted from the peripherals to the T1 interface circuitry 638 or the WAN server 640 
on the high bandwidth channel, that data may be time division or code division multiplexed 
onto an upstream logical channel of the 1.544 Mbps channel. 

Gateway 308 also include circuitry to interface the LAN 246 at the customer 

3 0 premises #2 to several other sources of incoming programming and/or data and to send data 

out on upstream mediums other than the DSL line such as the PSTN or a satellite uplink or 
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an HFC connection to a CATV headend. The details of the gateway 308 are given in the patent 
application HOME NETWORK FOR ORDERING AND DELIVERY OF VIDEO ON DEMAND, 
TELEPHONE AND OTHER DIGITAL SERVICES, filed 1/14/2000, serial number 09/483,681 
which is hereby incorporated by reference, but some of the circuitry will be summarized 
5 here for completeness. For example, the gateway couples a CATV headend 31 4 and HFC data 

path 316 to LAN 246 via a cable modem 318 and various other circuits in the gateway that 
perform necessary services and routing of data to and from the LAN 246. The gateway 
includes tuner, A/D, decoder, demultiplexer and demodulation circuitry represented by 
block 320 which performs various functions to interface the gateway to HFC 316. The HFC 
13S 316 can carry downstream conventional FDMA analog video broadcasts for video 

conferencing or CATV delivery, digital video broadcasts and/or downstredam DOCSIS data 
□ modulated onto upstream and downstream carriers. Thus, the gateway 308 can also request 
;p video-on-demand, video conferencing, wideband internet access or other services via the 

upstream logical channel on the HFC 316 as an alternative to DSL delivery. 
1^ The gateway 308 has a tuner for each downstream carrier on the HFC, all of which 

p are symbolized by block 320. The analog video tuner (not separately shown) tunes to 
%l whatever analog CATV video channel or video conferencing channel which has been requested 
y and outputs an RF signal which is then digitized and demodulated to a baseband NTSC, PAL or 
5j SECAM downstream digital video signal. This data is at too high a bandwidth to send over the 
2 0 LAN 246, so the data must be compressed. To do that, a video decoder in block 320 (not 

separately shown) converts the signal to YUV format and then it is compressed in an MPEG II 
or other encoder 322. Next, IP video circuit 324 encapsulates the compressed video into IP 
packets addressed to the peripheral which requested the program, and the IP packets are 
sent to a router/network interface circuit 326 which routes the packets onto the correct 

2 5 LAN (there may be more than one LAN coupled to the gateway) and drives them onto the LAN 

media. A CPU 328 coordinates all this activity. 

If another user at customer premises #2 ordered a second video-on-demand 
program to be delivered by HFC in addition to a video-on-demand program via wireless 
keyboard or wireless remote 330, another tuner is tuned by computer 328 to the 

3 0 appropriate HFC video-on-demand carrier and rejects all other signals. The output of the 

tuner is then digitized and will contain digitized video and audio signals and may also contain 
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IP packets of associated data. All this data will be on different program slots of one or more 
downstream channels from the CATV headend 314. A QAM or other demodulator in block 320 
then recovers the constellation points encoding all these signals and data and a transport 
demultiplexer in block 320 separates the video, audio and associated data constellation 
points into separate streams of decoded data. Conventional conditional access decryption 
follows and the resulting data is usually compressed into MPEG packets by MPEG encoder 
322 and encapsulated into IP packets by IP video circuit 324 and routed to the peripheral 
that requested it over LAN 246 via router/NIC 326. 

At the settop decoder boxes such as 252, the data or requested and pushed video-on- 
demand programs or video conference data delivered either by HFC 316 or DSL line is 
received and converted into NTSC, PAL or SECAM video signals for the associated television, 
such as TV 328. The settop decoders such as 252 may have a video phone or conventional 
video camera 334 coupled thereto to generate the upstream portion of a video conference as 
conventional NTSC, PAL or SECAM format video signals with audio. The settop decoder 
includes conventional circuitry to receive, digitize, compress and packetize upstream video 
and audio signals and address the packets to the router/NIC 326 in gateway 308. The router 
sends the upstream video conference packets to the dish transceiver 342, the cable modem 
318 or the DSL modem 244 for upstream transmission via satellite uplink, HFC 316 or 
DSL line 310, respectively. Thus, video conferencing can be achieved using the settop 
decoder 252 and television 328 for downstream data and the video camera 334 and settop 
decoder 252 for upstream video and data transmission. 

Returning to the consideration of video-on-demand and pushed programs and 
services, any associated data to be used with a video-on-demand or pushed program (such as 
a pushed home shopping program), to be sent to, for example, a phone 644 near the TV being 
viewed (for home shopping transactions) or personal computer 332, is converted to a 
format suitable for the personal computer or the phone. Both the phone 644 and the PC 332 
are plugged into the settop decoder 252 so as to receive the associated data so as to be able to 
interact with the vidoe-on-demand or pushed program being viewed for, for example, 
impulse buying. 
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Gateway 308 also includes tuner for DOCSIS data such as wideband internet access IP 
packets transmitted downstream on the HFC 316, said tuner being included within cable 
modem 318. 

The gateway 308 can also interface the LAN 246 to a conventional TV antenna 336. A 
5 tuner 338 under control of CPU 328 tunes to whatever conventional broadcast channel has 

been requested. The RF output of the tuner is then digitized in an A/D converter in block 
320 and demodulated by a video demodulator which is part of block 320 to generate an NTSC, 
PAL or SECAM baseband signal. A video decoder which is part of block 320 converts the 
video signal to YUV format and MPEG encoder 322 compresses the video data. IP video 
123 circuit 324 encapsulates the output of the MPEG encoder and sends it to router/NIC 326 
^ where it is routed to the appropriate settop decoder circuit for the TV that ordered the 
P broadcast. 

if. The gateway 308 can also interface the LAN 246 at customer premises #2 to a 

M~ satellite dish 340. The satellite dish can send multiple forms of signals to the gateway. For 

1 1> example, analog video signals such as C-band subscription broadcast video can be received 

C and/or digital video can be received such as DirecTV. Also, digital data services such as 
% } DirectPC may also be received. A separate tuner for each of these services is either part of 
yy ; dish receiver 342 or part of block 320. The DirecTV tuner will feed a QAM demodulator as 
S part of block 320 which detects the actual symbols sent for each constellation point and 
2 0 outputs a digital stream to a transport demultiplexer which, under the guidance of CPU 328, 
separates out the MPEG packets in the subchannels or program slots carrying only the 
programs that have been requested or pushed programs. The MPEG packets are then sent 
through a transcoder which is part of block 320 to adjust the bandwidth of the isochronous 
video data to the available bandwidth on the LAN 246 for current load conditions. The 

2 5 transcoder circuit is implemented on commercially available integrated circuits which were 

formerly manufactured by Imedia and are now manufactured by Terayon Communications 
Systems, of Santa Clara, Ca., the assignee of this patent application. The transcoder receives 
an input from the CPU 328 regarding how much compression is needed and then 
uncompresses the input MPEG packets and recompresses them down to the new bandwidth as 

3 0 new MPEG packets. A conditional access circuit then authenticates the requester as a 

subscriber and decrypts the data so that it can be viewed. The decrypted MPEG packets are 
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then sent to IP video circuit 324 for encapsulation into IP packets and then to router/NIC 
324 for routing and encapsulation into Ethernet packets and driving onto LAN 246. At the 
settop decoder box to which the Ethernet packets are addressed, they are received, 
decompressed and converted back into a video signal which is coupled to the TV. 
5 DirectPC signals arriving from dish 340 are tuned in dish transceiver 342 under 

control of CPU 328 and the output is coupled to a QPSK demodulator which recovers the IP 
packet data of the requested service. The IP packets are then sent directly to router/NIC 
326 for routing and encapsulation into Ethernet packets and transmission to one of the 
personal computers such as 332 or a network computer (not shown). 
1 £ Analog video signals such as C-band broadcasts that have been requested are tuned by 

g the dish transceiver 342 under command of the CPU 328. The output RF signal is digitized 
jf: and a video demodulator in circuit 320 converts it to baseband NTSC etc. A video decoder in 
fly circuit 320 then converts the NTSC signal into YUV format for compression in MPEG 
^ encoder 322. The compressed data is then sent to IP video circuit 324 for encapsulation 
1rg into IP packets and from there to router/NIC 326 for routing and encapsulation into 
jL Ethernet packets and transmission over the LAN to the requesting settop decoder. 

LP Gateway 308 and its LAN(s) and other input devices may be substituted for gateway 

214 in Figure 2 and gateways 28 and 30 in Figure 1. 
Ep The DSL headend multiplexer 240 works the same way as the headend multiplexer 

2# 10 in Figure 1 with regard to video-on-demand programs. Requests from the customers 
received by control computer 618 are converted to PIDs and transmitted to video servers 
646 and 648 via lines 650 and 652. These video servers then output the MPEG packets of 
the requested programs on data paths 654 and 656 from video server 1 and data paths 658 
and 660 from video server 2. Splitters 662 and 664 copy these data streams to each of the 

2 5 culling switches 666 and 668. The splitters also receive input IP packets from WAN 

gateway 640 via path 15 and from T-carrier interface circuit 638 via data paths 17 and 
672. These IP packets are copied out to the culling switches also. The culling switches cull 
out the MPEG packets of the requested video and pushed video programs and the IP packets of 
the requested services from the data streams from the splitters on data paths 676, 678, 

3 0 680 and 682 in accordance with culling data given to them on lines 614 and 616 from the 

control computer 618. The culled out data packets for customer #1 appear on line 684, and 
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the culled out data packets for customer #2 appear on line 686. Optional bandwidth 
recoders then adjust the bandwidth of the resulting data streams in accordance with 
commands from the control computer 618 transmitted via lines 692 and 694. The 
resulting output data on buses 305 and 624 are transmitted downstream by the DSL 
5 modems. 

***ln some embodiments within the genus of the invention, the pull multiplexer 
assumes that all cable modems and gateways have a sufficient number of tuners to tune in all 
the programs and/or services requested from a single customer premises. In such 
embodiments, the pull multiplexer simply gathers upstream program/service requests and 
1:B culls out the packets that encode the data of the requested programs and services. These 
J packets are then assembled into output streams for the appropriate media coupling the pull 
S multiplexer to the requesting customer and downstream messages are sent to the customer's 
! J modem or gateway telling it on which media, channel and subchannel/program slot each 

J- requested program and/or service can be found. In embodiments where there is only one 

Vj§ medium coupling the pull multiplexer to all the customers, the pull multiplexer just 

S3 assembles the requested program and service packets into one or more output streams to be 
fy transmitted in a corresponding number of logical channels. The pull multiplexer just puts 
yy the requested programs and/or services from a single premises into whatever subchannels 
g or program slots are available in logical channels that are not fully utilized and sends 
2 0 downstream messages to the customer's modems or gateways telling each customer the 

logical channel(s) and subchannel(s) upon which the program(s) and/or service(s) 
requested by that customer can be found. 

This assumption that all customer modems/gateways have a sufficient number of 
tuners to tune all the requested programs and/or services and that they can be spread out to 

2 5 whatever logical channels and subchannels are not being utilized is inconvenient for 

customers. Specifically, for a customer that might have 3 to 5 programs and/or services 
requested simultaneously, that customer might need as many as five tuners in his 
gateway/modem in a worst case scenario. This unnecessarily drives up the expense for the 
customer. 

3 0 Optionally, in some species within the genus, the cherry picker has a management 

process that pulls the requested programs and services onto the downstream medium 26 in 
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the most efficient way. Such a process is illustrated in the flowchart of Figure 5. This 
management process starts at steps 344 and 346 by receiving upstream program and 
service requests. Next, step 348 analyzes the incoming program and service requests to 
determine from which customer premises they came. Step 350 determines how many 
different program(s) and/or service(s) have been requested from the same customer 
premises. Step 352 then determines how many tuners each customer has in his 
gateway/cable modem such as 28 and 30. 

Next, in step 354, the management process determines which channels and 
subchannels have available capacity. 

Then the management process determines which channels and program slots to 
transmit the requested program(s) and/or service(s) on to enable all the requested 
program(s) and/or service(s)requested by the user to be received. The first step in that 
process is step 356 where the number of requested programs and/or services from each 
customer is compared to the number of tuners that customer has. 

Next, the process of generating the output streams for all the customers with 
outstanding requests starts by assigning a variable N (which will be the customer currently 
being processed in the loop) to an intial value of one in step 360. Step 362 sets the 
customer number identifying which customer is being processed to the value of N. Test 364 
then determines if customer #N has only one tuner. If so, test 366 determines if the 
number of requested programs and/or services by customer N is greater than one. If not, 
then the question is simply one of which logical channel in the downstream has the requisite 
number of subchannels available to carry the components of the requested program and/or 
service. Step 368 on Figure 5B finds a logical channel with a number of subchannels open 
that at least equals the number of components to be transmitted in the program and/or 
services requested. Step 370 then sends the PIDs, IP addresses and/or other identifying 
information for the components of the program/service that has been ordered to the culling 
switch that is culling out packets for the output stream being generated for the logical 
channel having the available subchannels found in step 368. Step 372 sends a downstream 
message to the gateway or cable modem of customer #N telling it which logical channel and 
subchannel the components of the requested program/service will be transmitted on so that 
the CPU in the cable modem or gateway can tune the tuner to the right carrier and 
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demultiplex the components of the requested program/service from the designated 
subchannels. Step 374 sends a message to the downstream transmitter of the logical channel 
on which the requested components are going to be sent identifying which packets in the 
input stream of the transmitter are to be put on which subchannels. Step 376 then 
5 increments N by one to start work on the next customer. Step 378 then determines if the 

last customer's requests have been processed, and, if so, processing vectors back to step 
346 to receive new program/service requests, as symbolized by step 380. If test 378 
determines that the last customer has not had her requests proceessed, processing vectors 
back to step 362 along line 379 to start the loop again to process the next customer. 

Returning to the consideration of step 364, if customer N has more than one tuner, 
5: then processing flows along line 365 to step 382 is performed to determine if the number of 
□ requested program(s) and/or services is greater than the number of tuners customer #N 

has. If not, step 384 is performed to find one or more logical channels with a sufficient 
M :; number of open subchannels to carry all components of the requested program(s) and/or 
VS service(s) to customer #N. Next, step 386 is performed to send the PIDs, IP addresses 
C and/or other identifying information for the components of the program/service ordered by 
fj: customer #N to the culling switch or switches that are generating the streams of data that 
yyi are to be modulated onto the logical channel or channels located in step 384 that will be used 
i;; to transmit the requested program(s)/service(s) to customer #N. The switch or switches 
2 0 then use those PIDs etc. to cull out the packets of the requested program(s)/service(s) and 

assemble the output streams. Generally, all the components for a single requested program 
or service will be transmitted on the same channel, so the pull multiplexer tries to find a 
logical channel that has a sufficient number of open subchannels to carry all the components 
for a particular program. For example, if a requested video-on-demand program has a 

2 5 video, audio and data component, then a logical channel with at least three open subchannels 

is preferred. However, the different components of a requested program/service can be sent 
on different logical channels if necessary as long as the downstream messages tell the cable 
modem or gateway where to find all the components. Step 388 is then performed to send a 
downstream message to the gateway or modem of customer #N telling it which channel(s) 

3 0 and subchannel(s) it will find the components of the requested program(s) and/or 

service(s) will be found. Processing then flows along line 389 to step 390. Step 390 sends 
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a message or messages to each of the downstream transmitters transmitting the logical 
channels located in step 384 to instruct them which packets (identified by PIDs etc.) to 
modulate onto which specific subchannels so that the customer will find all components of 
the ordered program(s)/services(s) on the logical channels and subchannels indicated in 
5 the downstream messages. Steps 392, 394, 396 and 398 increment N by one, determine if 

the last customer has been processed, and, if not, vector back to step 362 and, if so, vector 
back to step 346. 

Problems can arise when the number of programs/services requested by a 
particular customer exceeds the number of tuners that customer has if there are not enough 
1CD subchannels available to carry the requested data on a plurality of logical channels equal to 

the number of tuners the customer has. For example, suppose customer #1 has only one 
□ tuner in her gateway/cable modem 28 and this tuner is already tuned to logical channel 5 

jp for delivery of one video-on-demand program. Now suppose other residents of customer 
^ #1's household request three additional programs and services. If channel 5 has an 18 

it program slot capacity but there are only two open program slots on channel 5 that are not 

y: being used, there is a problem. In such a case, the management process may simply move 

S;j the program or service customer #1 is currently viewing/using on channel 5 to another 

Ly channel with adequate unused program slots and then add the three newly requested 

programs and/or services from customer #1's premises to that channel. The cherry picker 
2 0 will then send a downstream message either addressed directly to customer #1*s gateway or 
cable modem or broadcast to all gateways or cable modems that indicates the channel the 
program or service customer #1 was already tuned to is now being broadcast on and the fact 
that the three new requested program(s) and/or(services) are now being broadcast on the 
new channel and giving the PIDs of those program(s) and service(s) packets. 

2 5 There are a number of different scenarios for matching the number of requests to the 

available logical channels and subchannels and the number of tuners each customer has. Any 
process that can accommodate as many requests as possible given the loading of the 
subchannels and the number of tuners available will suffice to practice the invention. The 
following steps from the various sheets of the flowchart of Figures 5A through 5X are only 

3 0 one example of a process that can do the necessary processing. Returning to the 

consideration of step 366 on Figure 5A, if the number of requested program(s)/service(s) 
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is greater than one but customer N has only one tuner, then processing flows on line 400 to 
test 402. Test 402 determines if there is a single logical channel with enough open 
subchannels to carry all the components of all the programs and/or services requested by 
customer N. If there is such a channel, processing flows along line 402 to step 406. In step 
5 406, the PIDs, IP addresses or other information that identifies the packets containing data 

for the programs/services requested by customer N are sent to one culling switch. The 
culling switch these PIDs are sent to is the one which is generating the input data stream to 
the downstream transmitter which is transmitting the logical channel located in step 402. 
Next, step 408 is performed to send a downstream message to customer #N's modem or 
1[§ gateway telling it which logical channel and subchannel(s) on which it will find the 

J requested program (s)/service(s). Step 412 is then performed to send a message to the 

D downstream transmitter which is transmitting the logical channel found in step 402. This 

Jj: message tells the transmitter which packets to put on which subchannels of the logical 

channel so that the customer N gateway or modem will find them where it was told they will 
1=S be. Processing then vectors along path 414 to step 392. Steps 392, 394, 396 and 398 on 

□ Figure 5D are repeated to increment N and vector processing to the appropriate place to 

process the next customer or receive new requests. 
iy Returning to the consideration of test 402, if there is no single logical channel that 

±j has a sufficient number of subchannels available to carry all the components of the 
2 0 program(s)/service(s) that customer N has ordered, then processing flows along path 418 

to test 420. Test 420 determines if enough subchannels to carry all the components of the 
program(s)/service(s) that customer N ordered can be freed on any single logical channel 
by moving the data streams on subchannels already in use to unused subchannels on another 
logical channel. This process will look at the current load on all logical channels and 

2 5 subchannels and compare it to the needed number of subchannels and pick a logical channel 

that is closest to having a sufficient number of available subchannels. The number of 
subchannels needed to be freed will be determined and the other logical channels will be 
examined to determine if there is another logical channel with a sufficient number of 
available subchannels to which the data can be moved or if the same data on separate 

3 0 subchannels in use by different customers can be combined without adversely affecting the 

services and/or programs being received by the customer whose data needs to be moved. A 
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combination of data can be made if two different customers are watching the same program 
and the data is being sent on different subchannels of the same or different logical channels, 
and if the data is in 'synchronization". The data will be in synchronization if it is a 
broadcast that started at the same time for all users watching it or if the same video-on- 
5 demand movie or other production was ordered at the same time by two or more customers. 

If such a move or combination can be made to free a sufficient number of 
subchannels, then the move or combination will be made, as symbolized by step 422. 

To implement this move or combination, new PID and/or IP addresses etc. are sent to 
the culling switches to update their tables so that the culling switch generating the output 
W stream for the logical channel from which the data is being moved will stop culling out the 
J; data packets to be moved and the culling switch generating the data stream for the logical 

p channel to which they are being moved will start culling out the data packets. New messages 

;JJ are then sent to the transmitters involved so that they will put the data packets in the 

appropriate subchannels to which they are being moved on the new logical channel. Also, a 
new downstream message is sent to the modem or gateway of the customer whose data has 
H been moved telling it where it can continue to find the data of the requested 

J] program(s)/service(s). Then steps 392, 394, 396 and 398 on Fig. 5D are performed 
y again to increment N and begin processing the next customer. 

Returning to the consideration of step 420, suppose there is no move or combination 
2 0 that can be made to free enough subchannels to send all the requested programs/services to a 

customer with a single tuner. In such a case, step 424 is performed to send a message for 
display to the customer indicating there is insufficient bandwidth to deliver all the requested 
data and requesting that the customer make her request again later. Then steps 392, 394, 
396 and 398 on Fig. 5D are performed again to increment N and begin processing the next 

2 5 customer. 

Returning to the consideration of step 382, suppose customer #N has more than one 
tuner, but the number of program(s) and/or service(s) she ordered is greater than the 
number of tuners in her gateway or modem. If test 382 determines such to be the case, 
processing vectors to test 430 on Figure 5F. Test 430 determines whether enough 

3 0 subchannels are available on a number of logical channels equal to the numbers of tuners 

customer #N has to carry the program(s) and/or service(s) customer #N has ordered. 
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Basically, the load on all logical channels and subchannels is analyzed to determine if enough 
available subchannels can be found to carry the program(s)/service(s) requested by 
customer #N on a number of logical channels equal to the number of tuners this customer 
has. If so, step 432 is performed to send the PIDs, IP addresses or other packet identifying 
5 information that can be used to cull out the packets of the program(s)/service(s) requested 

by customer #N. These PIDs are sent to the appropriate culling switches after the logical 
channels that have capacity are selected and the requested program(s)/service(s) are 
divided up into groups that will fit on the available subchannels on various logical channels. 
Next, step 434 is performed to send messages to the modem or gateway of customer #N 
jfp informing it upon which logical channels and subchannels the requested program(s) and/or 
J? services will be found. Then path 436 is taken to step 392 on Figure 5D to increment N and 

§2 begin processing the next customer. 

:p Referring again to step 430, suppose that process 430 could not find enough 

\& available subchannels on a number of logical channels equal to the number of tuners the 

f S customer has. In that case, processing vectors to test 438. Test 438 determines if enough 

Ei subchannels can be freed to carry the requested programs and/or services to customer #N 

Jjjg by moving the data of programs and/or services in use by other customers to other logical 

Ly channels or by combining multiple requests for the same data. The combining aspect of the 

ij. process represented by step 438 represents analyzing new requests to determine if the 

2 0 same program and/or service is already being pulled by another customer on a subchannel 

or if the same program and/or service is already being broadcast as pushed data. If the 
requested data is already being pulled or pushed on other subchannels, then the processes 
represented by step 440 and 442 of sending messages to the customer gateways and the 
transmitters aand culling switches basically boils down to sending messages to the customer 

2 5 N gateway that tell it the logical channel(s) and subchannel(s) where the requested data is 

already being broadcasted or pulled by another customer. If the customer does not have 
enough tuners and the ones he has are already consumed by programs and/or services his 
family are already using and there are sufficient subchannels available on a logical channel 
to which one of the customer's tuners is already tuned, then a copy of the broadcast 

3 0 program/service or the program/service already being pulled by another customer is made 

on the available subchannels of the logical channel to which customer N is already tuned. 
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If step 438 concludes that enough subchannels can be freed by moving or combining 
data, then in step 440 the PIDs, IP addresses or other identifying information for both the 
customer #N requested programs and/or services and the programs and/or services that 
are being moved or combined are sent to the culling switches for the logical channels on 
5 which the customer N requested programs and services are to be sent and the new logical 

channels for the moved data. Also, messages are sent to the culling switches affected by 
programs and/or services that have been moved away to cause them to stop culling out the 
packets of the moved programs. Then step 442 is performed again to send messages to the 
gateway or modem of customer #N telling it where to find the requested program(s) and/or 

fjf service(s). Step 442 also sends messages to the gateways and modems of customers whose 
data has been moved telling them upon which logical channels and subchannels they may now 

a find the data of the programs and/or services they have been viewing or using. Then path 

IJj 444 is taken to step 392 to begin processing the next customer. 

sr.:: 

^ Returning again to test 438, if it is not possible to free enough subchannels to carry 

1JS the requested programs to customer N by moving and/or combining data, then path 448 is 

O taken to step 450 on Figure 5G. Step 450 sends an "Insufficient bandwidth message" to 

|! customer N for display to her on the TV, remote or other device from which she ordered the 

y program and/or service. Path 452 is then taken to step 392 to begin processing the next 

ji? customer requests or receive new requests. 

2 0 Although the invention has been disclosed in terms of the preferred and alternative 

embodiments disclosed herein, those skilled in the art will appreciate that modifications and 
improvements may be made without departing from the scope of the invention. All such 
modifications are intended to be included within the scope of the claims appended hereto. 
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What is claimed is: 

1 1. A head end apparatus for a cable television operator, comprising: 

2 one or more inputs for receiving streams of compressed data packets encoding 

3 a plurality of programs and/or services; 

4 one or more transmitters, transceivers or modems, each having an output 

5 coupled to a downstream transmission medium and an input for receiving a stream of 

6 packets containing data encoding one or more programs and/or services and any other 

7 data to be used with said programs and/or services; and 

8 a pull multiplexer coupled to receive upstream program and/or service 

9 requests and to receive said one or more streams of compressed data packets from 
1 0 said one or more inputs, and having one or more data outputs at each of which is 

1 1 output a stream of data packets containing data encoding one or more requested 

1 2 programs and/or services, each said data output being coupled to an input of one of 

1 3 said one or more transmitters, transceivers or modems, said pull multiplexer 

1 4 including a programmed computer to map one or more requested programs and/or 

1 5 services to program identifier codes, IP addresses or other identifying information 

1 6 that can be used by one or more culling switches that are part of said pull 

1 7 multiplexer to cull out data packets from said streams of compressed data packets 

1 8 received at said one or more inputs that contain data encoding said requested 

1 9 program(s) and/or service(s). 

1 2. The apparatus of claim 1 wherein said pull multiplexer further comprises means 

2 for variably adjusting the bandwidth of each said output stream of data packets in accordance 

3 with commands to conform the bandwidth of said output streams to the availability of 

4 bandwidth on the downstream medium. 

1 3. The apparatus of claim 1 wherein said pull multiplexer includes culling switch 

2 circuitry to select data packets defining one or more output data streams for transmission on 

3 one or more logical channels such that one or more subchannels carry data encoding popular 

4 programs and/or services that are to be transmitted downstream regardless of whether 

5 there are any current program and/or service requests for said popular programs and/or 
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6 services and to output said data packets defining said one or more popular programs and/or 

7 services at said data output. 

1 4. The apparatus of claim 1 wherein said pull multiplexer further comprises means 

2 for bandwidth management to insure that said output stream(s) of data packets at said one or 

3 more data outputs do not consume more bandwidth than is available on said downstream 

4 transmission medium. 

1 5. The apparatus of claim 1 wherein said pull multiplexer further comprises means 

2 for managing said output streams for maximum efficiency in transmitted requested 

3 programs and/or services so that as many requests as possible from as many customers as 

4 possible can be fulfilled. 

1 6. The apparatus of claim 1 wherein said pull multiplexer further comprises 

2 means for assembling data packets that comprise said output streams such that all the data 

3 packets that encode requested programs and/or services and associated data to be viewed 

4 and/or used at any particular customer premises are transmitted to said customer on a 

5 number of logical channels equal to or less than the number of tuners said customer has. 

1 7. The apparatus of claim 1 wherein said pull multiplexer further comprises a 

2 programmed microprocessor that functions to optimize the assembly of output streams of 

3 data packets by analyzing the number of requests for programs and/or services received 

4 from each customer and the number of tuners each said customer has and the current 

5 availability of subchannels on one or more logical channels and attempts to creates said 

6 output streams of data packets so that all the data packets encoding the programs and/or 

7 services each particular customer requested are transmitted on subchannels on a number of 

8 logical channels that does not exceed the number of tuners said customer has. 

1 8. The apparatus of claim 1 wherein said pull multiplexer further comprises a 

2 programmed microprocessor that functions to optimize the assembly of output streams of 

3 data packets by analyzing the number of requests for programs and/or services received 
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4 from each customer and the number of tuners each said customer has and the current 

5 availability of subchannels on one or more logical channels and attempts to creates said 

6 output streams of data packets so that all the data packets encoding the programs and/or 

7 services each particular customer requested are transmitted on subchannels on a number of 

8 logical channels that does not exceed the number of tuners said customer has including 

9 attempting to move or combine data being transmitted to other customers on other available 
1 0 subchannels of one or more other logical channels so as to make enough subchannels 

1 1 available on a number of logical channels equal to or less than the number of tuners each 

1 2 particular customer has such that all data of programs and/or services requested by that 

1 3 customer can be transmitted on a number of logical channels equal to the number of tuners 
said customer has. 

1 9. A head end for a cable TV system, comprising: 

2 a head end cherry picker multiplexer having a plurality of inputs for 

3 coupling to data paths to receive input data streams from one or more video servers, 

4 wide area network servers, and/or T-carrier interface circuitry or telephone 

5 company digital switches and having one or more outputs at each of which is 

6 generated an output data stream, and further comprising culling means for receiving 

7 upstream requests for program(s) and/or service(s) received from one or more 

8 customers and mapping said upstream requests to program identifier codes, IP 

9 addresses or other packet identifying information and for communicating said 

1 0 program identifier codes to said one or more video servers to cause them to output 

1 1 requested video-on-demand program data, said culling means using said packet 

1 2 identifying information to cull out packets from said input streams in one or more 

1 3 culling switches to generate said one or more said output data streams; 

1 4 a bank of one or more cable modems, each cable modem coupled to an output of 

1 5 said multiplexer to receive an output data data stream assembled by said multiplexer 

1 6 and coupled to receive one or more management and control messages from said 

1 7 multiplexer indicating upon which subchannel(s) the data packets encoding one or 

1 8 more program(s) and/or service(s) are to be transmitted, each cable modem for 

1 9 modulating the different program(s) and/or service(s) encoded in the data packets of 
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2 0 said output stream received from said multiplexer onto the subchannels designated in 

2 1 one or more said management and control messages received from said multiplexer. 

1 10. The apparatus of claim 9 wherein said culling means includes a microprocessor 

2 programmed to receive upstream packet data other than requests for programs and/or 

3 services and route said upstream packet data to the appropriate wide area network server 

4 and/or T-carrier interface circuitry or telephone company digital switch. 

1 11. The apparatus of claim 9 further comprising bandwidth compression circuitry 

2 coupled to receive said output data streams from said culling means and alter the bandwidth 

3 if necessary in accordance with the available bandwidth on a downstream medium to which 

4 said head end cherry picker multiplexer is coupled 
5 

1 12. The apparatus of claim 9 wherein said culling means includes a programmed 

2 microprocessor and stored data indicating how many tuners each customer has to tune into 

3 requested or pushed programs and/or services, said microprocessor programmed to analyze 

4 the number of requests received from each customer and the number of tuners said customer 

5 has and the available bandwidth on a shared downstream medium coupling said head end 

6 cherry picker multiplexer to all said customers, and for performing said culling process in 

7 such a way as to transmit as many requested programs and/or services as possible to each 

8 customer on a number of logical channels that is equal to or less than the number of tuners 

9 said customer has to tune said logical channel. 

1 13. A head end multiplexer system for a central office of a DSL system, comprising: 

2 one or more video inputs for receiving streams of video data from a video 

3 server; 

4 one or more IP inputs for receiving streams of IP packets from a server, 

5 router or gateway coupled to a wide area network; 

6 one or more wideband inputs for receiving telephony packets containing 

7 digital data from an interface to a wide band digital network such a T-carrier system 

8 or X.25 packet network; 
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9 one or more POTS inputs for receiving plain old telephone service analog 

1 0 signals from a POTS switch in a public service telephone network; 
1 1 one or more upstream inputs for receiving upstream program and/or service 

1 2 requests and upstream data; 

1 3 one or more culling switch means for culling out packets received at said 

1 4 video inputs, said IP inputs and said wideband inputs in accordance with culling 

1 5 selection criteria given to said one or more culling switch means and organizing the 

1 6 resulting culled packets into one or more output streams of packets, each output 

1 7 stream containing the data encoding programs and/or services requested by user(s) 
El 1 8 at one customer premises; 

~ 1 9 control means for processing upstream program and/or service requests 

p 2 0 received from users at all customer premises and generating said culling selection 

jSj 2 1 criteria for programs and/or services requested from each customer's premises 

jp 2 2 from said upstream program and/or service requests received from that customer's 

^ 2 3 premises, said control means also for generating management and control messages 

El 2 4 for transmission to each customer premises indicating which logical channel(s) and 

2 5 subchannel(s) on the DSL line coupled to said customer premises on which the 

y 26 requested program(s) and/or service(s) will be found, said control means also for 

2 7 generating management and control messages for controlling which channels and 

2 8 subchannels on which each program and/or service requested by a particular 

2 9 customer will be transmitted on a DSL line coupling said head end multiplexer to said 

3 0 customer premises; 

3 1 one or more DSL modems, each having an output for coupling to a DSL line 

3 2 coupling said head end multiplexer to one customer premises and each having one or 

3 3 more inputs for coupling to receive one of said output data streams from said culling 

3 4 switch means and to receive management and control messages for transmission to 

3 5 the customer premises said DSL modem is coupled to via a DSL line and to receive 

3 6 management and control messages for use by said DSL modem to control the logical 

3 7 channel(s) and subchannel(s) said DSL modem will use in transmitting data encoding 

3 8 said requested program(s) and/or service(s) to said customer, and each DSL modem 

3 9 having an input for coupling to one of said POTS inputs, and each DSL modem having 
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4 0 one or more outputs coupled to said upstream inputs of said control computer, each 

4 1 DSL modem having circuitry for transmitting data encoding one or more requested 

4 2 and/or pushed program(s) and/or service(s) on one or more channels of said DSL 

43 line; 

4 4 and wherein said control means includes routing circuitry including a 

4 5 microprocessor coupled to said upstream inputs for receiving upstream data packets 

4 6 and programmed to analyze the destination of each upstream data packet and route it 

4 7 to a WAN gateway or server or T-carrier interface circuitry. 

1 14. The apparatus of claim 13 wherein said control means includes means for 

2 analyzing the number of tuners each customer has and the number of requests each user has 

3 made and the bandwidth availability on a bidirectional channel and a wideband channel of said 

4 DSL line and for generating said culling selection criteria so that, as many times as possible, 

5 said requested program(s) and/or service(s) are sent on a number of logical channels that 

6 do not exceed the number of tuners said customer has. 

1 15. The apparatus of claim 13 wherein said head end cherry picker multiplexer 

2 further comprises bandwidth recoders coupled to receive output data streams from said 

3 culling switch means and functioning to alter the bandwidth of each said output stream in 

4 accordance with instructions, and wherein said control means further comprises means for 

5 analyzing the bandwidth availability on each customer's DSL line and for controlling said 

6 bandwidth recoders accordingly. 
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ABSTRACT 



A system for providing video-on-demand service, broadband internet access and 
other broadband services over T-carrier systems including a pull multiplexer 
cherrypicker at the head end is disclosed. The pull multiplexer receives upstream requests 
and cull out MPEG or other compressed video packets, IP packets and other data packet types 
to satisfy the requests or to send pushed programming downstream. The downstream can be 
DSL or HFC. Each customer has a cable modem, DSL modem or a gateway which interfaces 
multiple signal sources to a LAN to which settop decoders, digital phones, personal 
computers, digital FAX machines, video cameras, digital VCRs etc. can be attached. Each 
gateway can coupled the LAN to a DSL line or HFC through a cable modem or a satellite dish 
through a satellite transceiver. A PSTN and conventional TV antenna interface is also 
provided. 
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N BY ONE 



376 




ST CUSTOMER 
PROCESSED? 



NO 



378 



374 



FIG. 5B 



'IS NUMBER OF REQUESTED 
PROGRAM(S) AND/OR 
SERVICES GREATER THAN 
NUMBER OFTUNERS 
CUSTOMER N HAS? 



382 



428 
-YES- 



"n5" 

_i 



384 



NO, HAS 
MORE 
THAN ONE 
TUNER 



FIND ONE OR MORE LOGICAL CHANNELS 
WITH SUFFICIENT NUMBER OF OPEN 
SUBCHANNELS TO CARRY ALL 
COMPONENTS OF REQUESTED 
PROGRAM(S) AND/OR SERVICES TO 
CUSTOMER #N 



365 



386 



SEND PIDs, IP ADDRESSES AND/OR OTHER 
IDENTIFYING INFORMATION FOR THE 
COMPONENTS OF THE REQUESTED 
PROGRAM(S)/SERVICE(S) TO THE CULLING 
SWITCH(ES) THAT ARE GENERATING THE 
OUTPUT STREAM(S) THAT HAVE A SUFFICIENT 
NUMBER OF OPEN SUBCHANNELS FOR 
REQUESTED PROGRAM(S)/SERVICE(S) 



388 



400 



402 



'IS THERE A SINGLE LOGICAL 
'CHANNEL WITH ENOUGH OPEN 
/'SUBCHANNELS TO CARRY ALL THE ' 
COMPONENTS OF ALL THE 
CUSTOMER #N REQUESTED 
PROGRAMS AND SERVICES TO 
CUSTOMER #N? 



TO FIG. 5D 



SEND A DOWNSTREAM MESSAGE TO 
CUSTOMER #N GATEWAY OR MODEM TELLING 
IT WHICH CHANNEL AND SUBCHANNEL(S) ON 

WHICH IT WILL FIND THE REQUESTED 
PROGRAM(S)/SERVICE(S) 



404 



TO FIG. 5D 



418 



TO FIG. 5C 



389 



FIG. 5C 



406 



,YESi 
404 



SEND PIDs, IP ADDRESSES 
AND/OR OTHER IDENTIFYING 
INFORMATION FOR THE 
COMPONENTS OF THE 
REQUESTED 
PROGRAM(S)/SERVICE(S) 
TO THE CULLING SWITCH 
THAT IS GENERATING THE 
OUTPUT STREAM FOR THE 
LOGICAL CHANNEL THAT HAS 
A SUFFICIENT NUMBER OF 
OPEN SUBCHANNELS FOR 
THE 

PROGRAM(S)/SERVICE(S) 
REQUESTED BY CUSTOMER 
#N 



408 



SEND A DOWNSTREAM 
MESSAGE TO CUSTOMER #N 

GATEWAY OR MODEM 
TELLING IT WHICH CHANNEL 
AND SUBCHANNEL(S) ON 
WHICH IT WILL FIND THE 

REQUESTED 
PROGRAM(S)/SERVICE(S) 



TO FIG. 5E 



410 



418 



389 



390 



SEND MESSAGE TO DOWNSTREAM 
TRANSM ITTER(S) TELLING IT OR THEM 
WHICH PACKETS TO PUT ON WHICH 
SUBCHANNELS OF WHICH LOGICAL CHANNELS 
SO THAT CUSTOMER #N WILL FIND ALL 
COMPONENTS OFTHE REQUESTED 
PROGRAM(S)/SERVICE(S) ON THE 
DESIGNATED LOGICAL CHANNELS AND 
SUBCHANNELS 



436 



392 



TO FIG. 5E 



-NO 



^ INCREMENT ^_ 
N BY ONE 



444 




398 



LAST 
CUSTOMER 
PROCESSED? 

394 




NO-* 



VECTOR 
BACK TO 
STEP 362 



VECTOR 
BACK TO 
STEP 346 



414 



TO FIG. 5E 



F/G. 5D 



410 



412 



SEND MESSAGE TO 
DOWNSTREAM TRANSMITTER 
FOR LOGICAL CHANNEL FOUND 
IN STEP 402 TELLING IT WHICH 
PACKETS TO PUT ON WHICH 

SUBCHANNELS SO THAT 
CUSTOMER #N WILL FIND ALL 
COMPONENTS OF THE 
REQUESTED 
PROGRAM(S)/SERVICE(S) ON 
THE DESIGNATED LOGICAL 
CHANNEL AND SUBCHANNELS 



418 



414 



TO STEPS 392, 394, 396 AND 398 



CAN ENOUGH SUBCHANNELS TO CARRY THE 
REQUESTED PROGRAM(S)/SERVICE(S) TO CUSTOMER" 
N BE FREED ON ANY SINGLE LOGICAL CHANNEL BY 
MOVING OR COMBINING DATA ON SOME SUBCHANNELS 

ALREADY IN USE BY OTHER CUSTOMERS TO OTHER 
^SUBCHANNELS THAT ARE NOT CURRENTLY IN USE ON 
OTHER LOGICAL CHANNELS? 



L 



YES 



1 



MOVE DATA SELECTED TO NEW 
SUBCHANNELS BY SENDING NEW 
MESSAGES TO CULLING SWITCHES, 
TRANSMITTER AND TO GATEWAY OR 
MODEM AT CUSTOMER LOCATION 
AFFECTED BY MOVE 




FIG. 5E 




430 



'ARE THERE ENOUGH SUBCHANNELS 
AVAILABLE ON A NUMBER OF LOGICAL 
CHANNELS EQUAL TO THE NUMBER OF 
TUNERS CUSTOMER #N HAS? 



"yesT 

* 



432 



SEND PIDs, IP ADDRESSES OR OTHER PACKET 
IDENTIFYING INFORMATION TO CULLING 
SWITCHES OFTHE LOGICAL CHANNELS 
SELECTED TO START PROCESS OF ADDING 
DATA FOR PROGRAM(S) AND/OR SERVICER) 
REQUESTED BY CUSTOMER #N TO MULTIPLE 
OUTPUT CHANNELS 



434 



SEND MESSAGES TO MODEM OR GATEWAY 
OF CUSTOMER #N INFORMING IT UPON 
WHICH LOGICAL CHANNELS AND 
SUBCHANNELS IT WILL FIND THE DATA OF 
THE REQUESTED PROGRAM(S) AND/OR 
SERVICER) 



438 

\N ENOUGH SUBCHANNELS ON ] 
NUMBER OF LOGICAL CHANNELS 
EQUAL TO THE NUMBER OF CUSTOMER^ 
#N TUNERS BE FREED BY MOVING OR 

COMBINING DATA OF PROGRAMS 
v AND/OR SERVICES ALREADY IN USE 
JO OTHER LOGICAL CHANNELS? 



YES 



440 



SEND PIDs, IP ADDRESSES OR OTHER 
PACKET IDENTIFYING INFORMATION TO 
CULLING SWITCHES OFTHE LOGICAL 
CHANNELS SELECTED TO START 
PROCESS OF ADDING DATA FOR 
PROGRAM(S) AND/OR SERVICE(S) 
REQUESTED BY CUSTOMER #N AND 
THE MOVED, DATA TO MULTIPLE 
OUTPUT CHANNELS AND SEND 
MESSAGES TO CULLING SWITCHES 
THAT HAD BEEN CULLING OUT MOVED 
DATA TO CAUSE THEM TO STOP 
CULLING OUT DATA THAT IS NOW 
BEING SENT ON OTHER LOGICAL 
CHANNELS 



436 



448 

Fig. 5F 



436 



448 



442 



TO STEP 392 



mO $>l\p 392 



SEND MESSAGES TO MODEM OR GATEWAY OF 
CUSTOMER #N INFORMING IT UPON WHICH 
LOGICAL CHANNELS AND SUBCHANNELS IT WILL . 
FIND THE DATA OF THE REQUESTED 
PROGRAM(S) AND/OR SERVICER), AND SEND 
MESSAGES TO MODEMS OR GATEWAYS OF ALL 

CUSTOMERS AFFECTED BY MOVED OR 
CONSOLIDATED DATA TELLING THEM WHERE TO 
; ' NOW FIND THE DATA OF THE PROGRAM(S) 
AND/OR SERVICER) THEY WERE USING. 



450 



452 



SEND 
INSUFFICIENT 
BANDWIDTH 
MESSAGETO 
CUSTOMER N 
FOR DISPLAY 



FIG. 5G 
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DECLARATION FOR PATENT APPLICATION 



Inventor(s): Selim Shlomo Rakib, Fabrice Michel Raymond Quinard, 

and Peter Albert Monta 
Docket No. TER-012 

As a below-named inventor, I (We) hereby declare that: 

My correct residence, post office address and citizenship are stated below next to my 

name. 

I believe myself to be the original, first and sole inventor (if only one name is listed 
below) or an original and first joint inventor (if more than one name is listed below) of the 
subject matter which is disclosed and claimed and for which a patent is sought on the invention 
entitled: HEAD END MULTIPLEXER TO SELECT AND TRANSMIT VIDEO-ON-DEMAND AND OTHER 
REQUESTED PROGRAMS AND SERVICES. 

The specification of this subject matter: 

■ is attached hereto. 

□ was filed on ; 

was assigned serial No. ; 

which was amended on . 

I hereby state that I have reviewed and understand the contents of the above identified 
patent application, including the claims, as amended by any amendment(s) referred to above. 
I believe the subject matter claimed in the above-identified application to be new and to be 
unobvious to persons of ordinary skill in the art in view of the prior art of which I am aware. 
I further hereby state that the specification of the above identified patent application adequately 
describes how to make and use the claimed invention, and further that it sets forth the best mode 
for practicing the invention known to me as of the date that the application was filed. I 
acknowledge the duty to disclose information which is material to the examination of this 
application in accordance with 37 C.F.R. 1.56. I further acknowledge the duty to disclose 
information known to me to be material under 37 C.F.R. 1.56 to the examination of the claims in 
any continuation-in-part application filed under the conditions specified in 35 U.S.C. Section 
120 which became available between the filing date of the prior application or the national or 
PCT international filing date and the filing date of the continuation-in-part application. 

I hereby claim foreign priority benefits under 35 U.S.C. §119 of any foreign 
application(s) for patent or inventor's certificate listed below and have also identified below 
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any foreign application for patent or inventor's certificate having a filing date before that of the 
application on which priority is claimed. 

Application No. Country Filing Date Priority Claimed 



I hereby claim the benefit under 35 U.S.C. §120 of any United States application(s) 
listed below and, insofar as the subject matter of each of the claims of this application is not 
disclosed in these prior United States application(s) in the manner provided by 35 U.S.C. §112, 
I acknowledge the duty to disclose material information as defined in 37 C.F.R. §1 .56(a) which ' 
occurred between the filing date of the prior application(s) and the national or PCT 
international filing date of this application. 



Application No. Filing Date 


Status (Issued, Pending, Abandoned) 


FULL NAME OF 
INVENTOR 1 


FIRST Name 
SELIM 


MIDDLE Inrtial(s) 

SHLOMO 


1 ACT Morr-m 

uio i in am© 

RAKIB 


RESIDENCE AND 
CITIZENSHIP 


City 

CUPERTINO 


State or Foreign Country 
CALIFORNIA 


Country of Citizenship 
ISRAEL 


POSTOFFICE 
ADDRESS 


Number and Street 
10271 WEST ACRES 


City 

CUPERTINO 


State or Country Zip Code 
CALIFORNIA 95014 


FULL NAME OF 
INVENTOR 2 


FIRST Name 
FABRICE 


MIDDLE Initial(s) 
MICHEL RAYMOND 


LAST Name 
QUINARD 


RESIDENCE AND 
CITIZENSHIP 


City 

SAN JOSE 


State or Foreign Country 
CALIFORNIA 


Country of Citizenship 
FRANCE 


POSTOFFICE 
ADDRESS 


Number and Street 

3316 THOMPSON AVENUE 


City 

SAN JOSE 


State or Country Zip Code 
CALIFORNIA 95118 


FULL NAME OF 
INVENTOR 3 


FIRST Name 
PETER 


MIDDLE Initial(s) 
ALBERT 


LAST Name 
MONTA 


RESIDENCE AND 
CITIZENSHIP 


City 

PALO ALTO 


State or Foreign Country 
CALIFORNIA 


Country of Citizenship 
UNITED STATES 


POSTOFFICE 
ADDRESS 


Number and Street 

1540 OAK CREEK DRIVE 


City 

PALO ALTO 


State or Country Zip Code 
CALIFORNIA 94304 



I hereby appoint the following attorney(s) and/or agent(s) to prosecute this application 
and to transact all business in the United States Patent and Trademark Office connected 
therewith: 

Ronald C. Fish (28,843) 
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Address all telephone calls to Ronald C. Fish at telephone no. (408) 778-3624 
Address all correspondence to Ronald Craig Fish 

Falk & Fish 

Post Office Box 2258 

Morgan Hill, California 95038, U.S.A. 

FAX No. (408) 776-0426 

I hereby declare that all statements made herein of my own knowledge are true and that 
all statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made are 
punishable by fine or imprisonment, or both, under Title 18, United States Code, § 1001 and 
that such willful false statements may jeopardize the validity of the application or any patent 
issued thereon. 



Signature of Inventor 1 Date Signature of Inventor 2 Date 



Signature of Inventor 3 Date 
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